tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.01 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.Ym0sBUIU1q', fmt=raw size=1073741824 (finished: start all VMs, in 115.81 seconds) gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab: waiting for unit setup-gitlab.service gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for the VM to finish booting gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab # Filesystem UUID: fda9550f-b41a-4987-9b6f-d2ea15780427 gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] KASLR enabled gitlab # [ 0.000000] random: crng init done gitlab # [ 0.000000] Machine model: linux,dummy-virt gitlab # [ 0.000000] efi: UEFI not found. gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf] gitlab # [ 0.000000] Zone ranges: gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff] gitlab # [ 0.000000] DMA32 empty gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.000000] Device empty gitlab # [ 0.000000] Movable zone start for each node gitlab # [ 0.000000] Early memory node ranges gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe000000 gitlab # [ 0.000000] psci: probing for conduit method from DT. gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware. gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs gitlab # [ 0.000000] psci: Trusted OS migration not required gitlab # [ 0.000000] psci: SMC Calling Convention v1.1 gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 gitlab # [ 0.000000] Detected PIPT I-cache on CPU0 gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface gitlab # [ 0.000000] CPU features: detected: Spectre-v4 gitlab # [ 0.000000] CPU features: detected: Spectre-BHB gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 gitlab # [ 0.000000] alternatives: applying boot alternatives gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/i0z9lw7rilbdqs94gck7dclw8bqs56ck-nixos-system-gitlab-test/init regInfo=/nix/store/znabj9wy0f301yzz77nm3i8dvkgmzmz9-closure-info/registration console=ttyAMA0,115200n8 console=tty0 gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/znabj9wy0f301yzz77nm3i8dvkgmzmz9-closure-info/registration", will be passed to user space. gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.000000] software IO TLB: area num 4. gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB) gitlab # [ 0.000000] Fallback order for Node 0: 0 gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1572864 gitlab # [ 0.000000] Policy zone: Normal gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.000000] allocated 12582912 bytes of page_ext gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups gitlab # [ 0.000000] rcu: Hierarchical RCU implementation. gitlab # [ 0.000000] rcu: RCU event tracing is enabled. gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.000000] Rude variant of Tasks RCU enabled. gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled. gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 gitlab # [ 0.000000] GICv3: 256 SPIs implemented gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f20000 (indirect, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f30000 (flat, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f40000 gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f50000 gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns gitlab # [ 0.000032] arm-pv: using stolen time PV gitlab # [ 0.000385] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.000608] Console: colour dummy device 80x25 gitlab # [ 0.000616] printk: legacy console [tty0] enabled gitlab # [ 0.000804] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) gitlab # [ 0.000811] pid_max: default: 32768 minimum: 301 gitlab # [ 0.000892] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.001029] landlock: Up and running. gitlab # [ 0.001032] Yama: becoming mindful. gitlab # [ 0.001470] LSM support for eBPF active gitlab # [ 0.001702] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.001830] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.003121] cacheinfo: Unable to detect cache hierarchy for CPU 0 gitlab # [ 0.003863] rcu: Hierarchical SRCU implementation. gitlab # [ 0.003867] rcu: Max phase no-delay instances is 1000. gitlab # [ 0.004054] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.005158] fsl-mc MSI: its@8080000 domain created gitlab # [ 0.005255] EFI services will not be available. gitlab # [ 0.005496] smp: Bringing up secondary CPUs ... gitlab # [ 0.006201] Detected PIPT I-cache on CPU1 gitlab # [ 0.006304] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000 gitlab # [ 0.006438] GICv3: CPU1: using allocated LPI pending table @0x0000000100f60000 gitlab # [ 0.006571] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40] gitlab # [ 0.007798] Detected PIPT I-cache on CPU2 gitlab # [ 0.007909] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000 gitlab # [ 0.008043] GICv3: CPU2: using allocated LPI pending table @0x0000000100f70000 gitlab # [ 0.008175] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40] gitlab # [ 0.009304] Detected PIPT I-cache on CPU3 gitlab # [ 0.009436] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000 gitlab # [ 0.009570] GICv3: CPU3: using allocated LPI pending table @0x0000000100f80000 gitlab # [ 0.009706] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40] gitlab # [ 0.010266] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.010295] SMP: Total of 4 processors activated. gitlab # [ 0.010298] CPU: All CPU(s) started at EL1 gitlab # [ 0.010308] CPU features: detected: Branch Target Identification gitlab # [ 0.010313] CPU features: detected: ARMv8.4 Translation Table Level gitlab # [ 0.010316] CPU features: detected: Instruction cache invalidation not required for I/D coherence gitlab # [ 0.010319] CPU features: detected: Data cache clean to the PoU not required for I/D coherence gitlab # [ 0.010322] CPU features: detected: Common not Private translations gitlab # [ 0.010325] CPU features: detected: CRC32 instructions gitlab # [ 0.010328] CPU features: detected: Data cache clean to Point of Deep Persistence gitlab # [ 0.010331] CPU features: detected: Data cache clean to Point of Persistence gitlab # [ 0.010334] CPU features: detected: Data independent timing control (DIT) gitlab # [ 0.010336] CPU features: detected: E0PD gitlab # [ 0.010339] CPU features: detected: Enhanced Counter Virtualization gitlab # [ 0.010342] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) gitlab # [ 0.010345] CPU features: detected: Enhanced Virtualization Traps gitlab # [ 0.010348] CPU features: detected: Fine Grained Traps gitlab # [ 0.010351] CPU features: detected: Generic authentication (architected QARMA5 algorithm) gitlab # [ 0.010355] CPU features: detected: RCpc load-acquire (LDAPR) gitlab # [ 0.010358] CPU features: detected: LSE atomic instructions gitlab # [ 0.010361] CPU features: detected: Privileged Access Never gitlab # [ 0.010363] CPU features: detected: PMUv3 gitlab # [ 0.010365] CPU features: detected: RAS Extension Support gitlab # [ 0.010368] CPU features: detected: RASv1p1 Extension Support gitlab # [ 0.010370] CPU features: detected: Random Number Generator gitlab # [ 0.010372] CPU features: detected: Speculation barrier (SB) gitlab # [ 0.010375] CPU features: detected: Stage-2 Force Write-Back gitlab # [ 0.010377] CPU features: detected: TLB range maintenance instructions gitlab # [ 0.010381] CPU features: detected: Speculative Store Bypassing Safe (SSBS) gitlab # [ 0.010510] alternatives: applying system-wide alternatives gitlab # [ 0.013606] CPU features: detected: BBM Level 2 without TLB conflict abort gitlab # [ 0.013875] Memory: 5963744K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved) gitlab # [ 0.015477] devtmpfs: initialized gitlab # [ 0.019786] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.019865] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.020067] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL gitlab # [ 0.020072] 0 pages in range for non-PLT usage gitlab # [ 0.020073] 508288 pages in range for PLT usage gitlab # [ 0.020215] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.021097] DMI not present or invalid. gitlab # [ 0.024545] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.027494] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.027806] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.029812] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.029844] audit: initializing netlink subsys (disabled) gitlab # [ 0.030171] audit: type=2000 audit(0.028:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.030766] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.030770] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.030775] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.030778] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.030780] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.030863] cpuidle: using governor ladder gitlab # [ 0.030887] cpuidle: using governor menu gitlab # [ 0.031097] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. gitlab # [ 0.031336] ASID allocator initialised with 65536 entries gitlab # [ 0.032561] Serial: AMBA PL011 UART driver gitlab # [ 0.038060] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 gitlab # [ 0.038434] printk: console [ttyAMA0] enabled gitlab # [ 0.048782] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.048801] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.048811] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages gitlab # [ 0.048819] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page gitlab # [ 0.048827] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.048835] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.048844] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages gitlab # [ 0.048851] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page gitlab # [ 0.063192] fbcon: Taking over console gitlab # [ 0.063225] ACPI: Interpreter disabled. gitlab # [ 0.066346] iommu: Default domain type: Translated gitlab # [ 0.066359] iommu: DMA domain TLB invalidation policy: strict mode gitlab # [ 0.077352] SCSI subsystem initialized gitlab # [ 0.077901] usbcore: registered new interface driver usbfs gitlab # [ 0.077962] usbcore: registered new interface driver hub gitlab # [ 0.077988] usbcore: registered new device driver usb gitlab # [ 0.078371] pps_core: LinuxPPS API ver. 1 registered gitlab # [ 0.078377] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti gitlab # [ 0.078387] PTP clock support registered gitlab # [ 0.078434] EDAC MC: Ver: 3.0.0 gitlab # [ 0.079106] scmi_core: SCMI protocol bus registered gitlab # [ 0.080267] FPGA manager framework gitlab # [ 0.081494] vgaarb: loaded gitlab # [ 0.083686] clocksource: Switched to clocksource arch_sys_counter gitlab # [ 0.096409] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.096482] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.097386] netfs: FS-Cache loaded gitlab # [ 0.097759] pnp: PnP ACPI: disabled gitlab # [ 0.109178] NET: Registered PF_INET protocol family gitlab # [ 0.112115] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.171916] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.171996] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.172069] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.172490] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.173295] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.173459] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.173562] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.173735] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.173995] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.174055] NET: Registered PF_XDP protocol family gitlab # [ 0.174079] PCI: CLS 0 bytes, default 64 gitlab # [ 0.174455] Trying to unpack rootfs image as initramfs... gitlab # [ 0.192392] kvm [1]: HYP mode not available gitlab # [ 0.272771] Initialise system trusted keyrings gitlab # [ 0.273107] workingset: timestamp_bits=42 max_order=21 bucket_order=0 gitlab # [ 0.273904] squashfs: version 4.0 (2009/01/31) Phillip Lougher gitlab # [ 0.274018] 9p: Installing v9fs 9p2000 file system support gitlab # [ 0.288748] Key type asymmetric registered gitlab # [ 0.288786] Asymmetric key parser 'x509' registered gitlab # [ 0.288895] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) gitlab # [ 0.289206] io scheduler mq-deadline registered gitlab # [ 0.289224] io scheduler kyber registered gitlab # [ 0.304658] pl061_gpio 9030000.pl061: PL061 GPIO chip registered gitlab # [ 0.307873] ledtrig-cpu: registered to indicate activity on CPUs gitlab # [ 0.308604] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: gitlab # [ 0.308631] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 gitlab # [ 0.308684] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 gitlab # [ 0.308696] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 gitlab # [ 0.308742] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits gitlab # [ 0.308777] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] gitlab # [ 0.308943] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 gitlab # [ 0.308956] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.308963] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] gitlab # [ 0.308969] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] gitlab # [ 0.308975] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] gitlab # [ 0.309161] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.310130] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.310528] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.310562] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.310623] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.310647] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.311666] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.312141] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.312164] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.312214] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.313266] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.313674] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.313696] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.313746] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.314753] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.315178] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.315201] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.315259] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.316316] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.316729] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.316751] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.316801] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.317818] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.318228] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.318250] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.318299] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.319312] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.319732] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.319754] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.319812] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.319836] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.320972] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint gitlab # [ 0.321381] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.321439] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.322423] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.322851] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.322901] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.323780] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint gitlab # [ 0.324192] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] gitlab # [ 0.324739] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.325273] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] gitlab # [ 0.325296] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.325345] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.326386] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.326787] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.326810] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.326860] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.328120] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned gitlab # [ 0.328133] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned gitlab # [ 0.328140] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned gitlab # [ 0.328227] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned gitlab # [ 0.328325] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned gitlab # [ 0.328408] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned gitlab # [ 0.328515] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned gitlab # [ 0.328605] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned gitlab # [ 0.328687] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned gitlab # [ 0.328780] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned gitlab # [ 0.328882] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned gitlab # [ 0.328977] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned gitlab # [ 0.329114] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned gitlab # [ 0.329209] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned gitlab # [ 0.329243] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned gitlab # [ 0.329276] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned gitlab # [ 0.329309] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned gitlab # [ 0.329343] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned gitlab # [ 0.329376] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned gitlab # [ 0.329410] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned gitlab # [ 0.329443] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned gitlab # [ 0.329479] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned gitlab # [ 0.329514] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned gitlab # [ 0.329560] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned gitlab # [ 0.329604] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned gitlab # [ 0.329636] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned gitlab # [ 0.329669] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned gitlab # [ 0.329702] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned gitlab # [ 0.329734] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned gitlab # [ 0.329767] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned gitlab # [ 0.329800] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned gitlab # [ 0.329833] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned gitlab # [ 0.329866] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned gitlab # [ 0.329900] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned gitlab # [ 0.329941] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] gitlab # [ 0.329951] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] gitlab # [ 0.329956] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] gitlab # [ 0.332704] pci 0000:00:0a.0: enabling device (0000 -> 0002) gitlab # [ 0.367586] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) gitlab # [ 0.373882] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) gitlab # [ 0.381088] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) gitlab # [ 0.387296] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) gitlab # [ 0.393954] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) gitlab # [ 0.400304] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) gitlab # [ 0.407386] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) gitlab # [ 0.414007] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) gitlab # [ 0.420049] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) gitlab # [ 0.426293] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) gitlab # [ 0.433160] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) gitlab # [ 0.447964] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.452202] msm_serial: driver initialized gitlab # [ 0.452567] SuperH (H)SCI(F) driver initialized gitlab # [ 0.452680] STM32 USART driver initialized gitlab # [ 0.499876] loop: module loaded gitlab # [ 0.500484] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 0.505987] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 0.511054] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 0.516520] virtio_blk virtio5: [vdb] 12284600 512-byte logical blocks (6.29 GB/5.86 GiB) gitlab # [ 0.522518] megasas: 07.734.00.00-rc1 gitlab # [ 0.524916] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] gitlab # [ 0.530770] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.530820] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.536620] Using buffer write method gitlab # [ 0.536712] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] gitlab # [ 0.541448] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.541494] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.546762] Using buffer write method gitlab # [ 0.546812] Concatenating MTD devices: gitlab # [ 0.546819] (0): "0.flash" gitlab # [ 0.546826] (1): "0.flash" gitlab # [ 0.546832] into device "0.flash" gitlab # [ 0.849282] Freeing initrd memory: 27184K gitlab # [ 0.868498] tun: Universal TUN/TAP device driver, 1.6 gitlab # [ 0.877802] thunder_xcv, ver 1.0 gitlab # [ 0.877927] thunder_bgx, ver 1.0 gitlab # [ 0.878044] nicpf, ver 1.0 gitlab # [ 0.879964] e1000: Intel(R) PRO/1000 Network Driver gitlab # [ 0.879979] e1000: Copyright (c) 1999-2006 Intel Corporation. gitlab # [ 0.880064] e1000e: Intel(R) PRO/1000 Network Driver gitlab # [ 0.880082] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. gitlab # [ 0.880169] igb: Intel(R) Gigabit Ethernet Network Driver gitlab # [ 0.880180] igb: Copyright (c) 2007-2014 Intel Corporation. gitlab # [ 0.880247] igbvf: Intel(R) Gigabit Virtual Function Network Driver gitlab # [ 0.880258] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. gitlab # [ 0.880675] sky2: driver version 1.30 gitlab # [ 0.885816] usbcore: registered new interface driver usb-storage gitlab # [ 0.886166] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.886208] usbserial: USB Serial support registered for generic gitlab # [ 0.886395] ehci-pci 0000:00:0a.0: EHCI Host Controller gitlab # [ 0.886484] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 gitlab # [ 0.887399] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 gitlab # [ 0.888287] hv_vmbus: registering driver hyperv_keyboard gitlab # [ 0.891005] rtc-pl031 9010000.pl031: registered as rtc0 gitlab # [ 0.891073] rtc-pl031 9010000.pl031: setting system clock to 2026-09-04T07:40:32 UTC (1788507632) gitlab # [ 0.892202] i2c_dev: i2c /dev entries driver gitlab # [ 0.895805] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 gitlab # [ 0.897449] hub 1-0:1.0: USB hub found gitlab # [ 0.897586] hub 1-0:1.0: 6 ports detected gitlab # [ 0.900885] sdhci: Secure Digital Host Controller Interface driver gitlab # [ 0.900899] sdhci: Copyright(c) Pierre Ossman gitlab # [ 0.901736] Synopsys Designware Multimedia Card Interface Driver gitlab # [ 0.902955] sdhci-pltfm: SDHCI platform and OF driver helper gitlab # [ 0.908038] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 0.908963] usbcore: registered new interface driver usbhid gitlab # [ 0.908974] usbhid: USB HID core driver gitlab # [ 0.913550] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available gitlab # [ 0.917581] drop_monitor: Initializing network drop monitor service gitlab # [ 0.917951] NET: Registered PF_INET6 protocol family gitlab # [ 0.919633] Segment Routing with IPv6 gitlab # [ 0.919769] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.919910] NET: Registered PF_PACKET protocol family gitlab # [ 0.920277] 9pnet: Installing 9P2000 support gitlab # [ 0.924613] Key type dns_resolver registered gitlab # [ 0.942390] registered taskstats version 1 gitlab # [ 0.942841] Loading compiled-in X.509 certificates gitlab # [ 0.965277] Demotion targets for Node 0: null gitlab # [ 0.965632] Key type .fscrypt registered gitlab # [ 0.965641] Key type fscrypt-provisioning registered gitlab # [ 0.965868] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 0.965897] ima: Allocated hash algorithm: sha1 gitlab # [ 0.965950] ima: No architecture policies found gitlab # [ 0.967885] input: gpio-keys as /devices/platform/gpio-keys/input/input0 gitlab # [ 1.013181] clk: Disabling unused clocks gitlab # [ 1.013240] PM: genpd: Disabling unused power domains gitlab # [ 1.021520] Freeing unused kernel memory: 4736K gitlab # [ 1.021807] Run /init as init process gitlab # [ 1.068532] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.143805] usb 1-1: new high-speed USB device number 2 using ehci-pci gitlab # [ 1.298365] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 gitlab # [ 1.388518] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 gitlab # [ 1.403493] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.403565] systemd[1]: Detected virtualization qemu. gitlab # [ 1.403645] systemd[1]: Detected architecture arm64. gitlab # [ 1.403663] systemd[1]: Running in initrd. gitlab # [ 1.404598] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.404874] systemd[1]: Hostname set to . gitlab # [ 1.507835] usb 1-2: new high-speed USB device number 3 using ehci-pci gitlab # [ 1.658583] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.660053] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 gitlab # [ 1.660497] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 gitlab # [ 1.765855] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.790192] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.790702] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.790786] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.790811] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.790862] systemd[1]: Reached target Path Units. gitlab # [ 1.790896] systemd[1]: Reached target Slice Units. gitlab # [ 1.790930] systemd[1]: Reached target Swaps. gitlab # [ 1.790970] systemd[1]: Reached target Timer Units. gitlab # [ 1.791350] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.791758] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.792086] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.792408] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.792591] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.792635] systemd[1]: Reached target Socket Units. gitlab # [ 1.796343] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.799575] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.799778] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 1.808061] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 1.831387] systemd[1]: Starting Journal Service... gitlab # [ 1.836185] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.836465] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.840004] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 1.848859] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 1.851424] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.852696] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.853494] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 1.858165] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 1.882937] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 1.887510] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 1.892368] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 gitlab # [ 1.892600] [drm] features: -virgl +edid -resource_blob -host_visible gitlab # [ 1.892614] [drm] features: -context_init gitlab # [ 1.893951] [drm] number of scanouts: 1 gitlab # [ 1.893973] [drm] number of cap sets: 0 gitlab # [ 1.894866] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 1.898279] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.900755] systemd-journald[95]: Collecting audit messages is disabled. gitlab # [ 1.907996] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic gitlab # [ 1.908028] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 gitlab # [ 1.918733] Console: switching to colour frame buffer device 160x50 gitlab # [ 1.925633] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.926075] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.926115] systemd[1]: Reached target Local File Systems. gitlab # [ 1.933226] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.934435] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device gitlab # [ 1.956395] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.964258] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.977997] systemd-modules-load[96]: Using 4 probe threads gitlab # [ 1.982913] systemd[1]: Started Journal Service. gitlab # [ 1.982240] systemd-modules-load[96]: Module 'virtio_balloon' is built in gitlab # [ 1.983537] systemd-modules-load[96]: Module 'virtio_console' is built in gitlab # [ 1.984818] systemd-modules-load[96]: Module 'virtio_rng' is built in gitlab # [ 1.985938] systemd-modules-load[96]: Inserted module 'dm_mod' gitlab # [ 1.986964] systemd-modules-load[96]: Inserted module 'virtio_gpu' gitlab # [ 1.988569] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.996563] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 2.002898] systemd-udevd[105]: Using default interface naming scheme 'v261'. gitlab # [ 2.018329] systemd[1]: Finished Create System Files and Directories. gitlab # [ 2.027799] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 2.052881] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.118678] systemd-vconsole-setup[129]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.123912] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.654613] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.655653] systemd[1]: Reached target System Initialization. gitlab # [ 2.656566] systemd[1]: Reached target Basic System. gitlab # [ 2.860390] (udev-worker)[121]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.864113] (udev-worker)[121]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.885623] (udev-worker)[122]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.897987] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.907830] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.909582] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.930348] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.955358] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.962646] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.969436] systemd[1]: Mounting /sysroot... gitlab # [ 3.010695] EXT4-fs (vda): mounted filesystem fda9550f-b41a-4987-9b6f-d2ea15780427 r/w with ordered data mode. Quota mode: none. gitlab # [ 3.015459] systemd[1]: Mounted /sysroot. gitlab # [ 3.016348] systemd[1]: Reached target Initrd Root File System. gitlab # [ 3.017208] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.048059] systemd-sysroot-fstab-check[161]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.049850] systemd[1]: Reload requested from client PID 161 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.051457] systemd[1]: Reloading... gitlab # [ 3.178720] systemd[1]: Reloading finished in 128 ms. gitlab # [ 3.233957] systemd-sysroot-fstab-check[161]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.236106] systemd-sysroot-fstab-check[161]: Requesting swap.target/start/replace... gitlab # [ 3.239231] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.240854] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.242404] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.243989] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 3.273945] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 3.275453] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 3.496723] (udev-worker)[139]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory gitlab # [ 3.500083] (udev-worker)[139]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory gitlab # [ 3.511172] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.512532] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.513301] systemd[1]: Stopping Virtual Console Setup... gitlab # [ 3.514081] systemd[1]: Starting Virtual Console Setup... gitlab # [ 3.553020] systemd-vconsole-setup[183]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 3.555605] systemd[1]: Finished Virtual Console Setup. gitlab # [ 3.846567] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.850404] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.854298] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.876276] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.890168] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.907128] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 3.911383] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.917531] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 3.921241] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.925320] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.927748] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.937193] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.948327] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.951517] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.843937] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 4.922954] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 4.925440] systemd[1]: Reached target Initrd File Systems. gitlab # [ 4.927884] systemd[1]: Starting Find NixOS closure... gitlab # [ 4.931416] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 4.981800] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 4.986080] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 5.004137] systemd[1]: Finished Find NixOS closure. gitlab # [ 5.006550] systemd[1]: Reached target Initrd Default Target. gitlab # [ 5.009172] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 5.066681] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 5.069319] systemd[1]: Stopped target Basic System. gitlab # [ 5.071499] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 5.073940] systemd[1]: Stopped target Path Units. gitlab # [ 5.076100] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 5.079425] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 5.082791] systemd[1]: Stopped target Slice Units. gitlab # [ 5.085026] systemd[1]: Stopped target Socket Units. gitlab # [ 5.087191] systemd[1]: Stopped target System Initialization. gitlab # [ 5.092940] systemd[1]: Stopped target Swaps. gitlab # [ 5.095037] systemd[1]: Stopped target Timer Units. gitlab # [ 5.101807] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 5.107840] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 5.111287] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 5.114614] systemd[1]: Stopped Find NixOS closure. gitlab # [ 5.116527] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 5.118791] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 5.121119] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 5.123303] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 5.125164] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 5.127290] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 5.128855] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 5.131044] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 5.133197] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 5.135119] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 5.136873] systemd[1]: Stopped target Local File Systems. gitlab # [ 5.138271] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 5.139995] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 5.141783] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 5.143332] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 5.145099] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 5.146738] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 5.147939] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 5.149537] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 5.151024] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 5.152692] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 5.154034] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 5.155679] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 5.157128] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 5.158627] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 5.160313] systemd[1]: systemd-udevd.service: Consumed 2.567s CPU time over 3.211s wall clock time, 31.6M memory peak. gitlab # [ 5.162594] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 5.164249] systemd[1]: Closed udev Control Socket. gitlab # [ 5.165391] systemd[1]: Starting Cleanup udev Database... gitlab # [ 5.166632] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 5.168384] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 5.169848] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 5.171894] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 5.173598] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 5.175164] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 5.267379] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 5.270917] systemd[1]: Finished Cleanup udev Database. gitlab # [ 5.273526] systemd[1]: Reached target Switch Root. gitlab # [ 5.275683] systemd[1]: Starting NixOS Activation... gitlab # [ 5.496190] initrd-nixos-activation-start[221]: booting system configuration /nix/store/i0z9lw7rilbdqs94gck7dclw8bqs56ck-nixos-system-gitlab-test gitlab # [ 5.565074] initrd-nixos-activation-start[221]: running activation script... gitlab # [ 5.931332] initrd-nixos-activation-start[244]: setting up /etc... gitlab # [ 6.111597] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 6.115081] systemd[1]: Finished NixOS Activation. gitlab # [ 6.117328] systemd[1]: Starting Switch Root... gitlab # [ 6.173171] systemd[1]: Switching root. gitlab # [ 6.261297] systemd-journald[95]: Received SIGTERM from PID 1 (systemd). gitlab # [ 6.951942] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 6.952089] systemd[1]: Detected virtualization qemu. gitlab # [ 6.952198] systemd[1]: Detected architecture arm64. gitlab # [ 6.952411] systemd[1]: Detected first boot. gitlab # [ 6.953939] systemd[1]: Initializing machine ID from random generator. gitlab # [ 7.231456] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 7.364644] systemd[1]: Applying preset policy. gitlab # [ 7.626354] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 7.846342] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 7.847623] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 7.855011] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 7.861237] systemd[1]: Created slice Slice /system/getty. gitlab # [ 7.864109] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 7.868562] systemd[1]: Created slice User and Session Slice. gitlab # [ 7.869516] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 7.870310] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 7.871070] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 7.871909] systemd[1]: Expecting device /dev/ttyAMA0... gitlab # [ 7.872754] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 7.873601] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 7.874440] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 7.875293] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 7.876165] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 7.877013] systemd[1]: Reached target Path Units. gitlab # [ 7.877818] systemd[1]: Reached target Remote File Systems. gitlab # [ 7.878629] systemd[1]: Reached target Slice Units. gitlab # [ 7.879648] systemd[1]: Reached target Swaps. gitlab # [ 7.882334] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 7.885252] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 7.887223] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 7.891017] systemd[1]: Listening on Factory Reset Management. gitlab # [ 7.892694] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 7.902237] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 7.904924] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 7.909680] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 7.911571] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 7.912939] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.914050] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 7.920768] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 7.922290] systemd[1]: Listening on udev Control Socket. gitlab # [ 7.923851] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 7.934128] systemd[1]: Mounting Huge Pages File System... gitlab # [ 7.943187] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 7.970015] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 7.980219] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 7.986844] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 7.996918] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 7.998442] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 8.018561] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 8.019887] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 8.020797] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 8.035418] systemd[1]: Starting Load Kernel Module fuse... gitlab # [ 8.036511] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 8.048649] systemd[1]: Starting Journal Service... gitlab # [ 8.053543] systemd[1]: Starting Load Kernel Modules... gitlab # [ 8.061042] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 8.068231] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 8.069919] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 8.079125] fuse: init (API version 7.45) gitlab # [ 8.081872] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 8.091575] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 8.093501] systemd[1]: Mounted Huge Pages File System. gitlab # [ 8.094548] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 8.096283] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 8.097975] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 8.104372] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 8.105642] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 8.106569] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 8.107507] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 8.109457] systemd[1]: modprobe@fuse.service: Deactivated successfully. gitlab # [ 8.111810] systemd[1]: Finished Load Kernel Module fuse. gitlab # [ 8.124030] systemd[1]: Mounting FUSE Control File System... gitlab # [ 8.135765] EXT4-fs (vda): re-mounted fda9550f-b41a-4987-9b6f-d2ea15780427. gitlab # [ 8.145572] systemd-journald[315]: Collecting audit messages is enabled. gitlab # [ 8.155983] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 8.166828] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 8.168618] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 8.170094] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 8.174423] systemd[1]: Started Journal Service. gitlab # [ 8.174256] systemd-modules-load[316]: Using 3 probe threads gitlab # [ 8.175740] systemd-modules-load[316]: Module 'atkbd' is built in gitlab # [ 8.177246] systemd-modules-load[316]: Module 'loop' is built in gitlab # [ 8.178548] systemd-modules-load[316]: Inserted module 'tls' gitlab # [ 8.179883] systemd[1]: Finished Load Kernel Modules. gitlab # [ 8.181213] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 8.182720] systemd[1]: Mounted FUSE Control File System. gitlab # [ 8.196742] systemd-oomd[317]: No swap; memory pressure usage will be degraded gitlab # [ 8.198398] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 8.199611] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 8.200734] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 8.203093] systemd[1]: Starting Firewall... gitlab # [ 8.207131] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 8.208568] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 8.210480] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 8.232895] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 8.248243] systemd-journald[315]: Received client request to flush runtime journal. gitlab # [ 8.284313] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 8.286492] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 8.288800] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 8.290115] systemd[1]: Reached target First Boot Complete. gitlab # [ 8.290995] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 8.291828] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 8.292882] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 8.293869] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 8.294988] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 8.350372] systemd-udevd[354]: Using default interface naming scheme 'v261'. gitlab # [ 8.399067] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 8.800979] systemd[1]: Finished Firewall. gitlab # [ 8.847893] systemd[1]: Mounting /run/wrappers... gitlab # [ 8.894359] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 8.901980] systemd[1]: Mounted /run/wrappers. gitlab # [ 8.908179] systemd[1]: Reached target Local File Systems. gitlab # [ 8.910850] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 8.918037] systemd[1]: Starting register-nix-paths.service... gitlab # [ 8.923589] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 8.924771] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 8.938481] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 8.948396] systemd[1]: Starting Create System Files and Directories... gitlab # [ 8.980278] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 9.009998] systemd[1]: Finished Create System Files and Directories. gitlab # [ 9.091919] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 9.094457] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 9.108360] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 9.111034] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 9.115249] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 9.125830] (udev-worker)[398]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 9.132097] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. gitlab # [ 9.154924] (udev-worker)[388]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 9.159467] (udev-worker)[388]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 9.171146] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 9.188430] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 9.190463] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 9.192996] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 9.194726] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 9.196112] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 9.200253] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 9.202572] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 9.205430] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 9.206771] systemd[1]: Starting Update is Completed... gitlab # [ 9.232830] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 9.234252] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 9.235153] systemd[1]: suid-sgid-wrappers.service: Consumed 213ms CPU time over 308ms wall clock time, 6.1M memory peak, 1.9M read from disk. gitlab # [ 9.239372] systemd[1]: Finished Update is Completed. gitlab # [ 9.270119] mousedev: PS/2 mouse device common for all mice gitlab # [ 9.543402] systemd[1]: Finished register-nix-paths.service. gitlab # [ 9.544674] systemd[1]: Reached target System Initialization. gitlab # [ 9.545971] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 9.547553] systemd[1]: Started logrotate.timer. gitlab # [ 9.548358] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 9.549929] systemd[1]: Reached target Timer Units. gitlab # [ 9.550753] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 9.551982] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 9.562749] systemd[1]: Starting nixbot CI service socket... gitlab # [ 9.563880] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 9.566208] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 9.567223] systemd[1]: Reached target Socket Units. gitlab # [ 9.572081] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 9.617115] dbus-broker-launch[560]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 9.619009] dbus-broker-launch[560]: NSS returned no entry for 'systemd-timesync' gitlab # [ 9.620994] dbus-broker-launch[560]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 9.623891] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 9.638554] dbus-broker-launch[560]: Ready gitlab # [ 9.641449] systemd[1]: Reached target Basic System. gitlab # [ 9.645478] systemd[1]: Started backdoor.service. gitlab # [ 9.649751] systemd[1]: Starting gitlab-config.service... gitlab # [ 9.652751] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 9.677129] systemd[1]: Starting Logrotate configuration check... gitlab # [ 9.686372] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # connecting to host... gitlab # [ 9.699380] logrotate[565]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 9.702126] logrotate[565]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf gitlab # [ 9.703481] logrotate[565]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 9.704632] logrotate[565]: Reading state from file: /var/lib/logrotate.status gitlab # [ 9.705602] logrotate[565]: state file /var/lib/logrotate.status does not exist gitlab # [ 9.706562] logrotate[565]: Allocating hash table for state file, size 64 entries gitlab # [ 9.707661] logrotate[565]: Handling 4 logs gitlab # [ 9.708321] logrotate[565]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 9.710412] logrotate[565]: considering log /var/log/btmp gitlab # [ 9.711208] logrotate[565]: Creating new state gitlab # [ 9.711855] logrotate[565]: Now: 2026-09-04 07:40 gitlab # [ 9.716404] logrotate[565]: Last rotated at 2026-09-04 07:00 gitlab # [ 9.717377] logrotate[565]: log does not need rotating (log has already been rotated) gitlab # [ 9.718536] logrotate[565]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 9.720713] logrotate[565]: considering log /var/log/wtmp gitlab # [ 9.721580] logrotate[565]: Creating new state gitlab # [ 9.722229] logrotate[565]: Now: 2026-09-04 07:40 gitlab # [ 9.722987] logrotate[565]: Last rotated at 2026-09-04 07:00 gitlab # [ 9.723809] logrotate[565]: log does not need rotating (log has already been rotated) gitlab # [ 9.724973] logrotate[565]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 9.728256] logrotate[565]: switching euid from 0 to 165 and egid from 0 to 165 (pid 565) gitlab # [ 9.729467] logrotate[565]: considering log /var/gitlab/state/log/*.log gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 9.730337] logrotate[565]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 9.731501] logrotate[565]: Creating new state gitlab # [ 9.733827] logrotate[565]: switching euid from 165 to 0 and egid from 165 to 0 (pid 565) gitlab # [ 9.734886] logrotate[565]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab: connected to guest root shell gitlab # [ 9.737471] logrotate[565]: switching euid from 0 to 60 and egid from 0 to 60 (pid 565) gitlab: (connecting took 10.23 seconds) gitlab # [ 9.739018] logrotate[565]: considering log /var/log/nginx/*.log gitlab: (finished: waiting for the VM to finish booting, in 10.23 seconds) gitlab # [ 9.739862] logrotate[565]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 9.744384] logrotate[565]: Creating new state gitlab # [ 9.745070] logrotate[565]: not running postrotate script, since no logs were rotated gitlab # [ 9.746019] logrotate[565]: switching euid from 60 to 0 and egid from 60 to 0 (pid 565) gitlab # [ 9.747101] systemd[1]: Starting Post-Boot Actions... gitlab # [ 9.747987] systemd[1]: Started Reset console on configuration changes. gitlab # [ 9.754406] systemd[1]: Starting resolvconf update... gitlab # [ 9.757238] systemd[1]: Finished Logrotate configuration check. gitlab # [ 9.758758] systemd[1]: Finished Post-Boot Actions. gitlab # [ 9.782850] nsncd[566]: Sep 04 07:40:41.394 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 9.788258] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 9.789309] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 9.790158] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 9.791038] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 9.798712] systemd[1]: Starting User Login Management... gitlab # [ 9.874241] systemd-logind[612]: New seat seat0. gitlab # [ 9.878250] systemd-logind[612]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) gitlab # [ 9.880417] systemd-logind[612]: Watching system buttons on /dev/input/event0 (gpio-keys) gitlab # [ 9.881961] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 9.883223] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 9.884375] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 9.885355] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 9.886170] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 9.887036] systemd[1]: Started User Login Management. gitlab # [ 9.887795] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 9.890305] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 9.891306] systemd[1]: nscd.service: Consumed 27ms CPU time over 198ms wall clock time, 7.4M memory peak, 5.8M read from disk. gitlab # [ 9.896318] systemd[1]: Starting linger-users.service... gitlab # [ 9.901963] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 9.946505] nsncd[659]: Sep 04 07:40:41.554 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 9.949039] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 9.958495] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 gitlab # [ 9.962039] systemd[1]: Finished resolvconf update. gitlab # [ 9.981230] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 9.995423] systemd[1]: Finished linger-users.service. gitlab # [ 10.001405] systemd[1]: Reached target Preparation for Network. gitlab # [ 10.002502] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 10.003439] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 10.016839] systemd[1]: Starting DHCP Client... gitlab # [ 10.065193] systemd[1]: Starting Address configuration of eth1... gitlab # [ 10.080605] systemd[1]: Starting Extra networking commands.... gitlab # [ 10.102596] systemd[1]: Starting Virtual Console Setup... gitlab # [ 10.139309] network-addresses-eth1-start[688]: adding address 192.168.1.1/24... done gitlab # [ 10.148926] network-addresses-eth1-start[688]: adding address 2001:db8:1::1/64... done gitlab # [ 10.161151] systemd[1]: Finished Address configuration of eth1. gitlab # [ 10.170647] systemd-logind[612]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 10.187668] systemd-vconsole-setup[690]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 10.191382] systemd[1]: Finished Virtual Console Setup. gitlab # [ 10.209824] systemd[1]: Finished Extra networking commands.. gitlab # [ 10.212523] dhcpcd[717]: dhcpcd-10.3.2 starting gitlab # [ 10.213777] systemd[1]: Reached target Network. gitlab # [ 10.215094] dhcpcd[756]: dev: loaded udev gitlab # [ 10.220197] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 10.222313] systemd[1]: Starting Nginx Web Server... gitlab # [ 10.234282] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 10.234764] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 10.234183] systemd[1]: Starting PostgreSQL Server... gitlab # [ 10.240929] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 10.248389] systemd[1]: Starting Permit User Sessions... gitlab # [ 10.251652] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 10.285492] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 10.290387] systemd[1]: Finished Permit User Sessions. gitlab # [ 10.300362] systemd[1]: Started Getty on tty1. gitlab # [ 10.301261] systemd[1]: Reached target Login Prompts.[ 10.305252] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 10.305828] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # gitlab # [ 10.309111] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 10.309505] cfg80211: failed to load regulatory.db gitlab # [ 10.353777] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 10.351851] dhcpcd[756]: eth0: waiting for carrier gitlab # [ 10.353759] dhcpcd[756]: eth0: carrier acquired gitlab # [ 10.356274] dhcpcd[756]: DUID 00:01:00:01:32:2d:32:79:52:54:00:12:34:56 gitlab # [ 10.357555] dhcpcd[756]: eth0: IAID 00:12:34:56 gitlab # [ 10.358287] dhcpcd[756]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 10.427120] nginx-pre-start[789]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok gitlab # [ 10.429134] nginx-pre-start[789]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful gitlab # [ 10.434023] systemd[1]: Started Nginx Web Server. gitlab # [ 10.450573] redis-server[786]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 10.453262] redis-server[786]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 10.454762] redis-server[786]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=786, just started gitlab # [ 10.456514] redis-server[786]: Configuration loaded gitlab # [ 10.457386] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 10.458286] redis[786]: monotonic clock: ARM CNTVCT @ 1000 ticks/us gitlab # [ 10.459736] redis[786]: Running mode=standalone, port=0. gitlab # [ 10.461088] redis[786]: Server initialized gitlab # [ 10.461950] redis[786]: Ready to accept connections unix gitlab # [ 10.462943] redis[786]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 10.481193] postgresql-pre-start[796]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 10.483423] postgresql-pre-start[796]: This user must also own the server process. gitlab # [ 10.487953] postgresql-pre-start[796]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 10.489647] postgresql-pre-start[796]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 10.490992] postgresql-pre-start[796]: The default text search configuration will be set to "english". gitlab # [ 10.492232] postgresql-pre-start[796]: Data page checksums are enabled. gitlab # [ 10.493259] postgresql-pre-start[796]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 10.494625] postgresql-pre-start[796]: creating subdirectories ... ok gitlab # [ 10.495541] postgresql-pre-start[796]: selecting dynamic shared memory implementation ... posix gitlab # [ 10.532973] postgresql-pre-start[796]: selecting default "max_connections" ... 100 gitlab # [ 10.599867] postgresql-pre-start[796]: selecting default "shared_buffers" ... 128MB gitlab # [ 10.973301] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 11.179420] postgresql-pre-start[796]: selecting default time zone ... UTC gitlab # [ 11.183583] postgresql-pre-start[796]: creating configuration files ... ok gitlab # [ 11.348680] gitlab-workhorse[826]: time="2026-09-04T07:40:42Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 11.353825] gitlab-workhorse[826]: time="2026-09-04T07:40:42Z" level=info msg="Using redis/go-redis" gitlab # [ 11.357768] gitlab-workhorse[826]: time="2026-09-04T07:40:42Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 11.369319] dhcpcd[756]: eth0: soliciting a DHCP lease gitlab # [ 11.384872] dhcpcd[756]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 11.404452] dhcpcd[756]: eth0: probing address 10.0.2.15/24 gitlab # [ 11.500467] postgresql-pre-start[796]: running bootstrap script ... ok gitlab # [ 11.991127] dhcpcd[756]: eth0: soliciting an IPv6 router gitlab # [ 11.993976] dhcpcd[756]: eth0: Router Advertisement from fe80::2 gitlab # [ 11.996777] dhcpcd[756]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 11.999585] dhcpcd[756]: eth0: adding route to fec0::/64 gitlab # [ 12.002085] dhcpcd[756]: eth0: adding default route via fe80::2 gitlab # [ 12.318396] postgresql-pre-start[796]: performing post-bootstrap initialization ... ok gitlab # [ 12.594526] postgresql-pre-start[796]: syncing data to disk ... ok gitlab # [ 12.597465] postgresql-pre-start[796]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 12.601467] postgresql-pre-start[796]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 12.607873] postgresql-pre-start[796]: Success. You can now start the database server using: gitlab # [ 12.611500] postgresql-pre-start[796]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 12.812972] postgres[851]: [851] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 12.819248] postgres[851]: [851] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 12.823700] postgres[851]: [851] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 12.828228] postgres[851]: [851] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 12.833128] postgres[864]: [864] LOG: database system was shut down at 2026-09-04 07:40:43 GMT gitlab # [ 12.837054] postgres[851]: [851] LOG: database system is ready to accept connections gitlab # [ 12.841134] systemd[1]: Started PostgreSQL Server. gitlab # [ 12.847371] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 13.017087] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[858]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 13.022349] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[858]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 13.131020] systemd[1]: Finished gitlab-config.service. gitlab # [ 13.134537] systemd[1]: Started gitaly.service. gitlab # [ 13.216382] postgresql-setup-start[876]: CREATE DATABASE gitlab # [ 13.257834] postgresql-setup-start[904]: CREATE ROLE gitlab # [ 13.288356] postgresql-setup-start[906]: ALTER DATABASE gitlab # [ 13.337864] postgresql-setup-start[911]: CREATE ROLE gitlab # [ 13.341344] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 13.343852] systemd[1]: Reached target PostgreSQL. gitlab # [ 13.349742] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 13.360706] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 13.589833] gitlab-postgresql-start[921]: CREATE DATABASE gitlab # [ 13.664613] gitlab-postgresql-start[933]: CREATE EXTENSION gitlab # [ 13.770740] gitlab-postgresql-start[935]: CREATE EXTENSION gitlab # [ 13.776413] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 14.035755] gitaly[899]: time="2026-09-04T07:40:45.647Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=899 gitlab # [ 14.044410] gitaly[899]: time="2026-09-04T07:40:45.648Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=899 gitlab # [ 14.046664] gitaly[899]: time="2026-09-04T07:40:45.648Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=899 gitlab # [ 14.052225] gitaly[899]: time="2026-09-04T07:40:45.648Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=899 gitlab # [ 14.054584] gitaly[899]: time="2026-09-04T07:40:45.648Z" level=info msg="Starting Gitaly" pid=899 version= gitlab # [ 14.363801] gitaly[899]: time="2026-09-04T07:40:45.976Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=326 pid=899 gitlab # [ 14.366570] gitaly[899]: time="2026-09-04T07:40:45.976Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=899 gitlab # [ 14.368951] gitaly[899]: time="2026-09-04T07:40:45.977Z" level=info msg="finished initializing command factory" duration_ms=0 pid=899 gitlab # [ 14.371229] gitaly[899]: time="2026-09-04T07:40:45.977Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-899/git-exec-495504572.d/git pid=899 gitlab # [ 14.374174] gitaly[899]: time="2026-09-04T07:40:45.986Z" level=info msg="finished detecting git version" duration_ms=8 pid=899 gitlab # [ 14.376400] gitaly[899]: time="2026-09-04T07:40:45.986Z" level=info msg="using Git version" pid=899 version=2.53.g gitlab # [ 14.378337] gitaly[899]: time="2026-09-04T07:40:45.986Z" level=info msg="clearing disk cache object folder" pid=899 storage=default gitlab # [ 14.380729] gitaly[899]: time="2026-09-04T07:40:45.987Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3262281519 pid=899 storage=default gitlab # [ 14.384162] gitaly[899]: time="2026-09-04T07:40:45.987Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3262281519 pid=899 storage=default gitlab # [ 14.387591] gitaly[899]: time="2026-09-04T07:40:45.987Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=899 gitlab # [ 14.391315] gitaly[899]: time="2026-09-04T07:40:45.987Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=899 gitlab # [ 14.395453] gitaly[899]: time="2026-09-04T07:40:45.987Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3262281519 clear_duration_ms=0 pid=899 storage=default gitlab # [ 14.427575] gitaly[899]: time="2026-09-04T07:40:46.039Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=899 gitlab # [ 14.432230] gitaly[899]: time="2026-09-04T07:40:46.039Z" level=info msg="counting repositories" pid=899 gitlab # [ 14.434632] gitaly[899]: time="2026-09-04T07:40:46.040Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=899 schema=unix gitlab # [ 14.438930] gitaly[899]: time="2026-09-04T07:40:46.040Z" level=info msg="listening at address" address=/run/gitaly/gitaly-899/sock.d/intern pid=899 schema=unix gitlab # [ 14.443015] gitaly[899]: time="2026-09-04T07:40:46.040Z" level=info msg="starting to count repositories" pid=899 storage_path=/var/gitlab/state/repositories gitlab # [ 14.446799] gitaly[899]: time="2026-09-04T07:40:46.041Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=899 storage_path=/var/gitlab/state/repositories gitlab # [ 14.451601] gitaly[899]: time="2026-09-04T07:40:46.041Z" level=info msg="completed counting all repositories" counting_duration=1 pid=899 gitlab # [ 14.455307] gitaly[899]: time="2026-09-04T07:40:46.041Z" level=info msg="finished tempdir cleaner walk" pid=899 storage=default time_ms=0 gitlab # [ 14.458921] gitaly[899]: time="2026-09-04T07:40:46.042Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=899 gitlab # [ 14.462359] gitaly[899]: time="2026-09-04T07:40:46.042Z" level=info msg="Started Gitaly" duration_ms=394 pid=899 gitlab # [ 14.465133] gitaly[899]: time="2026-09-04T07:40:46.042Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=899 gitlab # [ 14.468464] gitaly[899]: time="2026-09-04T07:40:46.043Z" level=info msg="maintenance: daily scheduled" pid=899 scheduled="2026-09-04 12:00:00 +0000 UTC" gitlab # [ 15.310597] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[916]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 15.314448] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[916]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 15.348180] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[916]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 15.633725] dhcpcd[756]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 15.638785] dhcpcd[756]: eth0: adding route to 10.0.2.0/24 gitlab # [ 15.641455] dhcpcd[756]: eth0: adding default route via 10.0.2.2 gitlab # [ 15.847622] systemd[1]: Started DHCP Client. gitlab # [ 15.851527] systemd[1]: Reached target Network is Online. gitlab # [ 18.186162] gitaly[899]: time="2026-09-04T07:40:49.796Z" level=info msg="License database preloaded" duration_ms=4148 pid=899 gitlab # [ 74.771927] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[916]: W, [2026-09-04T07:41:46.382686 #916] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 78.870000] postgres[1560]: [1560] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 78.871482] postgres[1560]: [1560] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 78.872820] postgres[1560]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 78.874098] postgres[1560]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 78.875289] postgres[1560]: attidentity AS identity, gitlab # [ 78.876096] postgres[1560]: attgenerated as attgenerated gitlab # [ 78.878111] postgres[1560]: FROM pg_attribute a gitlab # [ 78.878799] postgres[1560]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 78.880037] postgres[1560]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 78.880953] postgres[1560]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 78.882329] postgres[1560]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 78.883270] postgres[1560]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 78.884166] postgres[1560]: ORDER BY a.attnum gitlab # [ 78.884806] postgres[1560]: gitlab # [ 81.444273] gitlab-workhorse[826]: time="2026-09-04T07:41:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 85.343986] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1620]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 85.344495] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1620]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 91.450321] gitlab-workhorse[826]: time="2026-09-04T07:42:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 101.451929] gitlab-workhorse[826]: time="2026-09-04T07:42:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 111.461778] gitlab-workhorse[826]: time="2026-09-04T07:42:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 114.057440] postgres[1732]: [1732] ERROR: relation "table_without_models" does not exist gitlab # [ 114.057825] postgres[1732]: [1732] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 121.479135] gitlab-workhorse[826]: time="2026-09-04T07:42:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 131.482375] gitlab-workhorse[826]: time="2026-09-04T07:42:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 141.483396] gitlab-workhorse[826]: time="2026-09-04T07:42:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 144.981785] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 144.992312] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 144.995825] systemd[1]: Starting gitlab.service... gitlab # [ 145.668686] bundle[2126]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 145.669259] bundle[2126]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 145.671501] bundle[2126]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 151.494627] gitlab-workhorse[826]: time="2026-09-04T07:43:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 152.128603] bundle[2126]: {"timestamp":"2026-09-04T07:43:03.696Z","pid":2126,"message":"* Enabling systemd notification integration"} gitlab # [ 152.133684] bundle[2126]: {"timestamp":"2026-09-04T07:43:03.740Z","pid":2126,"message":"Puma starting in cluster mode..."} gitlab # [ 152.138223] bundle[2126]: {"timestamp":"2026-09-04T07:43:03.740Z","pid":2126,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 152.143022] bundle[2126]: {"timestamp":"2026-09-04T07:43:03.740Z","pid":2126,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 152.148961] bundle[2126]: {"timestamp":"2026-09-04T07:43:03.740Z","pid":2126,"message":"* Min threads: 0"} gitlab # [ 152.152978] bundle[2126]: {"timestamp":"2026-09-04T07:43:03.740Z","pid":2126,"message":"* Max threads: 4"} gitlab # [ 152.156881] bundle[2126]: {"timestamp":"2026-09-04T07:43:03.740Z","pid":2126,"message":"* Environment: production"} gitlab # [ 152.161062] bundle[2126]: {"timestamp":"2026-09-04T07:43:03.740Z","pid":2126,"message":"* Master PID: 2126"} gitlab # [ 152.165031] bundle[2126]: {"timestamp":"2026-09-04T07:43:03.740Z","pid":2126,"message":"* Workers: 2"} gitlab # [ 152.168901] bundle[2126]: {"timestamp":"2026-09-04T07:43:03.740Z","pid":2126,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 152.173862] bundle[2126]: {"timestamp":"2026-09-04T07:43:03.740Z","pid":2126,"message":"* Preloading application"} gitlab # [ 152.220973] sidekiq-cluster[2125]: {"severity":"INFO","time":"2026-09-04T07:43:03.793Z","message":"Starting cluster with 1 processes"} gitlab # [ 161.502536] gitlab-workhorse[826]: time="2026-09-04T07:43:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 171.512842] gitlab-workhorse[826]: time="2026-09-04T07:43:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 181.513933] gitlab-workhorse[826]: time="2026-09-04T07:43:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 191.517538] gitlab-workhorse[826]: time="2026-09-04T07:43:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 201.518393] gitlab-workhorse[826]: time="2026-09-04T07:43:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 202.104984] bundle[2126]: W, [2026-09-04T07:43:53.716159 #2126] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 206.862289] sidekiq-cluster[2193]: 2026-09-04T07:43:58.473Z pid=2193 tid=xmh INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2193, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433582080} gitlab # [ 207.223101] sidekiq-cluster[2193]: W, [2026-09-04T07:43:58.835418 #2193] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 207.398256] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:43:59.010Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 211.526369] gitlab-workhorse[826]: time="2026-09-04T07:44:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 211.952369] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.563Z","message":"GitLab reliable fetch activated!"} gitlab # [ 211.957485] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.563Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 211.989472] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.601Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 211.996441] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.604Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 212.003465] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.607Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 212.010223] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.610Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 212.017717] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.613Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 212.024417] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.616Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 212.030726] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.618Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 212.036269] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.621Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 212.041167] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.623Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 212.045785] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.625Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 212.050546] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.628Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 212.054827] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.631Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 212.058570] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.633Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 212.062355] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.635Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 212.065926] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.638Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 212.069327] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.640Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 212.072368] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.644Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 212.075197] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.647Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 212.078411] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.650Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 212.081343] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.653Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 212.084374] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.656Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 212.087431] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.659Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 212.090194] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.662Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 212.092863] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.665Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 212.095464] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.668Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 212.098043] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.671Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 212.100366] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.674Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 212.103687] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.678Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 212.106180] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.681Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 212.108648] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.685Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 212.110868] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.688Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 212.113536] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.691Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 212.115840] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.694Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 212.118492] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.698Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 212.120986] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.701Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 212.123401] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.703Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 212.125933] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.706Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 212.128218] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.709Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 212.130534] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.711Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 212.132884] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.714Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 212.135338] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.716Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 212.137853] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.719Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 212.140298] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.721Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 212.142589] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.724Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 212.145136] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.727Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 212.147679] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.729Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 212.150271] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.731Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 212.152720] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.733Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 212.155058] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.735Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 212.157516] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.737Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 212.159825] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.739Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 212.162221] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.742Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 212.164482] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.753Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 212.166933] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.756Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 212.169308] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.758Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 212.171543] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.761Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 212.173910] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.763Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 212.176200] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.765Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 212.178427] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.767Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 212.180702] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.769Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 212.182710] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.772Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 212.184790] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.773Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 212.186918] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.776Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 212.189165] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.779Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 212.191383] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.781Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 212.194250] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.783Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 212.197126] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.785Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 212.199290] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.787Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 212.201694] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.789Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 212.203963] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.791Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 212.206349] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.793Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 212.208575] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.794Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 212.210774] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.796Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 212.213174] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.799Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 212.215473] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.800Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 212.217919] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.803Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 212.220114] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.804Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 212.222603] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.806Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 212.224879] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.808Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 212.227020] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.810Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 212.229774] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.812Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 212.232381] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.814Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 212.234832] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.817Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 212.237268] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.819Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 212.239616] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.821Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 212.241985] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.823Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 212.244332] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.825Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 212.246557] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.827Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 212.248924] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.829Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 212.251218] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.831Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 212.253634] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.833Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 212.255851] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.835Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 212.258291] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.837Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 212.260746] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.839Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 212.262788] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.841Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 212.265219] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.844Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 212.267467] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.846Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 212.269854] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.848Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 212.272059] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.854Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 212.274257] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.856Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 212.276429] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.859Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 212.278699] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.862Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 212.280823] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.865Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 212.283014] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.868Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 212.285474] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.871Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 212.287823] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.873Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 212.290093] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.875Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 212.292368] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.878Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 212.294566] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:03.880Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 221.527669] gitlab-workhorse[826]: time="2026-09-04T07:44:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 231.539048] gitlab-workhorse[826]: time="2026-09-04T07:44:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 241.539904] gitlab-workhorse[826]: time="2026-09-04T07:44:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 251.542326] gitlab-workhorse[826]: time="2026-09-04T07:44:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 258.635691] postgres[3085]: [3085] ERROR: relation "table_without_models" does not exist gitlab # [ 258.638897] postgres[3085]: [3085] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 261.543884] gitlab-workhorse[826]: time="2026-09-04T07:44:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 263.722917] postgres[3123]: [3123] ERROR: relation "table_without_models" does not exist gitlab # [ 263.723255] postgres[3123]: [3123] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 263.795385] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:55.407Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 263.804368] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:55.410Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 263.806430] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:55.410Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 263.808154] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:55.410Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 263.810048] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:55.412Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 266.709526] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:58.321Z","message":"Cleaning working queues"} gitlab # [ 266.713670] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:58.325Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"c791017a1d6b045f43d292d7","created_at":"2026-09-04T07:42:55.900Z","trace_propagation_headers":{"sentry-trace":"84ce89c0dfd6414392ce768b1c75e488-fdf4c70444cd4dd5","baggage":"sentry-trace_id=84ce89c0dfd6414392ce768b1c75e488,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"2fa2b9aba4e8f527035e6264d91fbdf2","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:55.915Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-c791017a1d6b045f43d292d7: start","job_status":"start","queue_duration_s":122.409895,"scheduling_latency_s":122.409963} gitlab # [ 267.079498] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:44:58.690Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"c791017a1d6b045f43d292d7","created_at":"2026-09-04T07:42:55.900Z","trace_propagation_headers":{"sentry-trace":"84ce89c0dfd6414392ce768b1c75e488-fdf4c70444cd4dd5","baggage":"sentry-trace_id=84ce89c0dfd6414392ce768b1c75e488,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"2fa2b9aba4e8f527035e6264d91fbdf2","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:55.915Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-c791017a1d6b045f43d292d7: done: 0.365303 sec","job_status":"done","queue_duration_s":122.409895,"scheduling_latency_s":122.409963,"redis_calls":29,"redis_duration_s":0.012384,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007094,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003284,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002006,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.207248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.21154982,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.365303,"completed_at":"2026-09-04T07:44:58.690Z","load_balancing_strategy":"primary","db_duration_s":0.107823,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 270.413732] bundle[2126]: {"timestamp":"2026-09-04T07:45:02.024Z","pid":2126,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 270.414206] bundle[2126]: {"timestamp":"2026-09-04T07:45:02.024Z","pid":2126,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 270.414352] bundle[2126]: {"timestamp":"2026-09-04T07:45:02.024Z","pid":2126,"message":"! #\u003cThread:0x0000ed174a79f780 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 270.414702] bundle[2126]: {"timestamp":"2026-09-04T07:45:02.025Z","pid":2126,"message":"! #\u003cThread:0x0000ed174a9eea90 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 270.414959] bundle[2126]: {"timestamp":"2026-09-04T07:45:02.025Z","pid":2126,"message":"Use Ctrl-C to stop"} gitlab # [ 270.415074] bundle[2126]: {"timestamp":"2026-09-04T07:45:02.025Z","pid":2126,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 271.305281] bundle[2126]: {"timestamp":"2026-09-04T07:45:02.916Z","pid":2126,"message":"- Worker 0 (PID: 3240) booted in 0.85s, phase: 0"} gitlab # [ 271.309652] bundle[2126]: {"timestamp":"2026-09-04T07:45:02.921Z","pid":2126,"message":"- Worker 1 (PID: 3244) booted in 0.83s, phase: 0"} gitlab # [ 271.319895] systemd[1]: Started gitlab.service. gitlab # [ 271.322529] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 271.333798] systemd[1]: Starting setup-gitlab.service... gitlab # [ 271.397594] setup-gitlab-start[3277]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 276.642584] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:08 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 5155 gitlab # [ 276.650187] setup-gitlab-start[3277]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 276.653511] setup-gitlab-start[3277]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 276.676573] runuser[3312]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 277.414257] setup-gitlab-start[3313]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 277.421749] setup-gitlab-start[3313]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 277.428399] setup-gitlab-start[3313]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 278.216631] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:09.826Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c3235b29ace8cd152af57710","created_at":"2026-09-04T07:45:09.696Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57054c45057c4c026fd14fbe10f93981","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.820Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c3235b29ace8cd152af57710: start","job_status":"start","queue_duration_s":0.004982,"scheduling_latency_s":0.005077} gitlab # [ 278.616677] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:10.226Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c3235b29ace8cd152af57710","created_at":"2026-09-04T07:45:09.696Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57054c45057c4c026fd14fbe10f93981","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.820Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c3235b29ace8cd152af57710: done: 0.401187 sec","job_status":"done","queue_duration_s":0.004982,"scheduling_latency_s":0.005077,"redis_calls":10,"redis_duration_s":0.031905,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004536,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01982,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007549,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.102766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00350584,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.401187,"completed_at":"2026-09-04T07:45:10.226Z","load_balancing_strategy":"primary","db_duration_s":0.150138,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 278.729499] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:10.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"92f930221d59969dca2fdab7","created_at":"2026-09-04T07:45:09.852Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"728062000522b21ec8f82dece29ef687","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.867Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-92f930221d59969dca2fdab7: start","job_status":"start","queue_duration_s":0.381151,"scheduling_latency_s":0.38124} gitlab # [ 278.751226] setup-gitlab-start[3313]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 278.754030] setup-gitlab-start[3313]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 278.756575] setup-gitlab-start[3313]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 279.239489] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:10.849Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"92f930221d59969dca2fdab7","created_at":"2026-09-04T07:45:09.852Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"728062000522b21ec8f82dece29ef687","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.867Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-92f930221d59969dca2fdab7: done: 0.600768 sec","job_status":"done","queue_duration_s":0.381151,"scheduling_latency_s":0.38124,"redis_calls":14,"redis_duration_s":0.054745,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003349,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.020288,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.031108,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.041,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.250448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00832828,"exclusive_lock_hold_duration_s":0.37785186000000004,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.600768,"completed_at":"2026-09-04T07:45:10.848Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.068876,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.348505] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:10.858Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6ade7337aaae741059323e93","created_at":"2026-09-04T07:45:09.922Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93c7f4344c36d8e865f5bdbf32cd1cc3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.971Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6ade7337aaae741059323e93: start","job_status":"start","queue_duration_s":0.886204,"scheduling_latency_s":0.886272} gitlab # [ 279.415221] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.025Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6ade7337aaae741059323e93","created_at":"2026-09-04T07:45:09.922Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93c7f4344c36d8e865f5bdbf32cd1cc3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:09.971Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6ade7337aaae741059323e93: done: 0.167964 sec","job_status":"done","queue_duration_s":0.886204,"scheduling_latency_s":0.886272,"redis_calls":13,"redis_duration_s":0.008404,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000659,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005192,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002553,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02788912,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.167964,"completed_at":"2026-09-04T07:45:11.025Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015501,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 279.501791] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.034Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"54962c5d28f51c3f95167e08","created_at":"2026-09-04T07:45:10.032Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a651069467f7b771307716c783c5dc8","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.051Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-54962c5d28f51c3f95167e08: start","job_status":"start","queue_duration_s":0.983076,"scheduling_latency_s":0.983145} gitlab # [ 279.521428] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.126Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"54962c5d28f51c3f95167e08","created_at":"2026-09-04T07:45:10.032Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a651069467f7b771307716c783c5dc8","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.051Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-54962c5d28f51c3f95167e08: done: 0.09265 sec","job_status":"done","queue_duration_s":0.983076,"scheduling_latency_s":0.983145,"redis_calls":11,"redis_duration_s":0.004029,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000755,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002146,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00129716,"duration_s":0.09265,"completed_at":"2026-09-04T07:45:11.126Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.577753] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.135Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"70984cc85183643126f198ab","created_at":"2026-09-04T07:45:10.072Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"250a614cbc86dd559774c492d1fa1421","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.099Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-70984cc85183643126f198ab: start","job_status":"start","queue_duration_s":1.035536,"scheduling_latency_s":1.035608} gitlab # [ 279.810815] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.421Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"70984cc85183643126f198ab","created_at":"2026-09-04T07:45:10.072Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"250a614cbc86dd559774c492d1fa1421","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.099Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-70984cc85183643126f198ab: done: 0.286808 sec","job_status":"done","queue_duration_s":1.035536,"scheduling_latency_s":1.035608,"redis_calls":16,"redis_duration_s":0.065792,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.053402,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00872,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00367,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00341796,"duration_s":0.286808,"completed_at":"2026-09-04T07:45:11.421Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.059968,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.905635] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.427Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b71cddfcb724a4e2010f0c28","created_at":"2026-09-04T07:45:10.171Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"537d2c4f769d3f7d23618c6dff52295c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.216Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b71cddfcb724a4e2010f0c28: start","job_status":"start","queue_duration_s":1.210802,"scheduling_latency_s":1.210862} gitlab # [ 279.924108] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"b71cddfcb724a4e2010f0c28","created_at":"2026-09-04T07:45:10.171Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"537d2c4f769d3f7d23618c6dff52295c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.216Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-b71cddfcb724a4e2010f0c28: done: 0.090148 sec","job_status":"done","queue_duration_s":1.210802,"scheduling_latency_s":1.210862,"redis_calls":12,"redis_duration_s":0.004681,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001682,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00078,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069666,"duration_s":0.090148,"completed_at":"2026-09-04T07:45:11.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023119,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 279.979868] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"eadd9f85c08a1f8ba8bb4e8a","created_at":"2026-09-04T07:45:10.251Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d81cb31aced602e0b3fb366b26efa48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:45:10.275Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-eadd9f85c08a1f8ba8bb4e8a: start","job_status":"start","queue_duration_s":1.245606,"scheduling_latency_s":1.245654} gitlab # [ 279.995892] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.548Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 280.000158] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.562Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"eadd9f85c08a1f8ba8bb4e8a","created_at":"2026-09-04T07:45:10.251Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d81cb31aced602e0b3fb366b26efa48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:45:10.275Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-eadd9f85c08a1f8ba8bb4e8a: done: 0.040812 sec","job_status":"done","queue_duration_s":1.245606,"scheduling_latency_s":1.245654,"redis_calls":10,"redis_duration_s":0.003031,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000627,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000668,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045464,"duration_s":0.040812,"completed_at":"2026-09-04T07:45:11.561Z","load_balancing_strategy":"primary","db_duration_s":0.000804,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.042515] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.564Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4d138b6fe47e24f0d2af191e","created_at":"2026-09-04T07:45:10.337Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.404Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4d138b6fe47e24f0d2af191e: start","job_status":"start","queue_duration_s":1.159224,"scheduling_latency_s":1.159255} gitlab # [ 280.131869] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.743Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4d138b6fe47e24f0d2af191e","created_at":"2026-09-04T07:45:10.337Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.404Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4d138b6fe47e24f0d2af191e: done: 0.179219 sec","job_status":"done","queue_duration_s":1.159224,"scheduling_latency_s":1.159255,"redis_calls":71,"redis_duration_s":0.02104,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002421,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001637,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.016139,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000843,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.148102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043144,"duration_s":0.179219,"completed_at":"2026-09-04T07:45:11.743Z","load_balancing_strategy":"primary","db_duration_s":0.003875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.218041] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.746Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"a26e9feae3a669382cbf80b4","created_at":"2026-09-04T07:45:10.441Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94133039a1aa5c62aba4e2d12dd154bd","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.554Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-a26e9feae3a669382cbf80b4: start","job_status":"start","queue_duration_s":1.1924,"scheduling_latency_s":1.192439} gitlab # [ 280.233684] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"a26e9feae3a669382cbf80b4","created_at":"2026-09-04T07:45:10.441Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94133039a1aa5c62aba4e2d12dd154bd","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.554Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-a26e9feae3a669382cbf80b4: done: 0.048343 sec","job_status":"done","queue_duration_s":1.1924,"scheduling_latency_s":1.192439,"redis_calls":10,"redis_duration_s":0.003132,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000584,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001937,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000611,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042706,"duration_s":0.048343,"completed_at":"2026-09-04T07:45:11.794Z","load_balancing_strategy":"primary","db_duration_s":0.006431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.277497] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.797Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3698e2c71031713150f34dca","created_at":"2026-09-04T07:45:10.571Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"736f2ba347eb7ae39eb9445f041b80c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.590Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3698e2c71031713150f34dca: start","job_status":"start","queue_duration_s":1.207099,"scheduling_latency_s":1.207131} gitlab # [ 280.292644] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3698e2c71031713150f34dca","created_at":"2026-09-04T07:45:10.571Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"736f2ba347eb7ae39eb9445f041b80c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.590Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3698e2c71031713150f34dca: done: 0.026204 sec","job_status":"done","queue_duration_s":1.207099,"scheduling_latency_s":1.207131,"redis_calls":10,"redis_duration_s":0.002563,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000492,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001473,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000598,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035132,"duration_s":0.026204,"completed_at":"2026-09-04T07:45:11.823Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.338427] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.825Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"28f8a93675d2afbf163fa569","created_at":"2026-09-04T07:45:10.611Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d919d925b5d3e740418938768b0c9da1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.624Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-28f8a93675d2afbf163fa569: start","job_status":"start","queue_duration_s":1.201036,"scheduling_latency_s":1.201056} gitlab # [ 280.352926] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.856Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"28f8a93675d2afbf163fa569","created_at":"2026-09-04T07:45:10.611Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d919d925b5d3e740418938768b0c9da1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.624Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-28f8a93675d2afbf163fa569: done: 0.031916 sec","job_status":"done","queue_duration_s":1.201036,"scheduling_latency_s":1.201056,"redis_calls":12,"redis_duration_s":0.003094,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000502,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001122,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062474,"exclusive_lock_hold_duration_s":0.008947700000000001,"duration_s":0.031916,"completed_at":"2026-09-04T07:45:11.856Z","load_balancing_strategy":"primary","db_duration_s":0.0035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.395529] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.858Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"d82ce641af863837c3827cfc","created_at":"2026-09-04T07:45:10.637Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e7e4396d35b83701ad4b8b2afc66d18","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.648Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-d82ce641af863837c3827cfc: start","job_status":"start","queue_duration_s":1.210075,"scheduling_latency_s":1.210095} gitlab # [ 280.409240] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.889Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"d82ce641af863837c3827cfc","created_at":"2026-09-04T07:45:10.637Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e7e4396d35b83701ad4b8b2afc66d18","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.648Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-d82ce641af863837c3827cfc: done: 0.030904 sec","job_status":"done","queue_duration_s":1.210075,"scheduling_latency_s":1.210095,"redis_calls":11,"redis_duration_s":0.002791,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000516,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001478,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000797,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034158,"duration_s":0.030904,"completed_at":"2026-09-04T07:45:11.889Z","load_balancing_strategy":"primary","db_duration_s":0.003385,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.450748] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:11.891Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ef4b145298587fe57acf2362","created_at":"2026-09-04T07:45:10.655Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d12ac155075de7ebd40278ae1501ca1d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.665Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ef4b145298587fe57acf2362: start","job_status":"start","queue_duration_s":1.225914,"scheduling_latency_s":1.225935} gitlab # [ 280.540442] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.152Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ef4b145298587fe57acf2362","created_at":"2026-09-04T07:45:10.655Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d12ac155075de7ebd40278ae1501ca1d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.665Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ef4b145298587fe57acf2362: done: 0.260958 sec","job_status":"done","queue_duration_s":1.225914,"scheduling_latency_s":1.225935,"redis_calls":12,"redis_duration_s":0.0034869999999999996,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000526,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001547,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001414,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.031,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.222552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00089196,"exclusive_lock_hold_duration_s":0.2361521,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.260958,"completed_at":"2026-09-04T07:45:12.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.617377] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.154Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c9a9040d36bdda578b88e325","created_at":"2026-09-04T07:45:10.682Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8dfcd178d32f4f701a6714ad03937a6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.696Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c9a9040d36bdda578b88e325: start","job_status":"start","queue_duration_s":1.458212,"scheduling_latency_s":1.458239} gitlab # [ 280.633070] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.181Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c9a9040d36bdda578b88e325","created_at":"2026-09-04T07:45:10.682Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8dfcd178d32f4f701a6714ad03937a6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.696Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c9a9040d36bdda578b88e325: done: 0.027648 sec","job_status":"done","queue_duration_s":1.458212,"scheduling_latency_s":1.458239,"redis_calls":12,"redis_duration_s":0.003172,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000529,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001473,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065406,"exclusive_lock_hold_duration_s":0.00390548,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.027648,"completed_at":"2026-09-04T07:45:12.181Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001731,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.677077] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"47d2410e2ee96b430fa2cb8d","created_at":"2026-09-04T07:45:10.701Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74e977e00f16eefc0b41eab336aae598","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:45:10.722Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-47d2410e2ee96b430fa2cb8d: start","job_status":"start","queue_duration_s":1.460752,"scheduling_latency_s":1.46077} gitlab # [ 280.690868] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.197Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 280.694319] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.206Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"47d2410e2ee96b430fa2cb8d","created_at":"2026-09-04T07:45:10.701Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74e977e00f16eefc0b41eab336aae598","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:45:10.722Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-47d2410e2ee96b430fa2cb8d: done: 0.022702 sec","job_status":"done","queue_duration_s":1.460752,"scheduling_latency_s":1.46077,"redis_calls":10,"redis_duration_s":0.002529,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000524,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001495,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034242,"duration_s":0.022702,"completed_at":"2026-09-04T07:45:12.206Z","load_balancing_strategy":"primary","db_duration_s":0.000494,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.736584] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.208Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"fe20f9f603a8225245915c51","created_at":"2026-09-04T07:45:10.736Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8961f29acca55323f7a16b79c1178363","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.762Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-fe20f9f603a8225245915c51: start","job_status":"start","queue_duration_s":1.445669,"scheduling_latency_s":1.445689} gitlab # [ 280.752157] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.231Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"fe20f9f603a8225245915c51","created_at":"2026-09-04T07:45:10.736Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8961f29acca55323f7a16b79c1178363","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.762Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-fe20f9f603a8225245915c51: done: 0.023857 sec","job_status":"done","queue_duration_s":1.445669,"scheduling_latency_s":1.445689,"redis_calls":11,"redis_duration_s":0.002937,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000599,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001451,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000373,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031838,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.023857,"completed_at":"2026-09-04T07:45:12.231Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.796776] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.233Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6ad9ab15e57153597bf5e7fd","created_at":"2026-09-04T07:45:10.807Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75d695b599eb3d525a78e044835b6927","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.840Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6ad9ab15e57153597bf5e7fd: start","job_status":"start","queue_duration_s":1.393147,"scheduling_latency_s":1.393176} gitlab # [ 280.811603] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6ad9ab15e57153597bf5e7fd","created_at":"2026-09-04T07:45:10.807Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75d695b599eb3d525a78e044835b6927","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.840Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6ad9ab15e57153597bf5e7fd: done: 0.062447 sec","job_status":"done","queue_duration_s":1.393147,"scheduling_latency_s":1.393176,"redis_calls":12,"redis_duration_s":0.00385,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001603,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00073264,"exclusive_lock_hold_duration_s":0.02214426,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.062447,"completed_at":"2026-09-04T07:45:12.295Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013737,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.856859] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.300Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"ac1e4c894c446e043dda1152","created_at":"2026-09-04T07:45:10.860Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ce42897034e2e594209a0430f3be524","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.888Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-ac1e4c894c446e043dda1152: start","job_status":"start","queue_duration_s":1.411773,"scheduling_latency_s":1.411827} gitlab # [ 280.870369] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"ac1e4c894c446e043dda1152","created_at":"2026-09-04T07:45:10.860Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ce42897034e2e594209a0430f3be524","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.888Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-ac1e4c894c446e043dda1152: done: 0.084219 sec","job_status":"done","queue_duration_s":1.411773,"scheduling_latency_s":1.411827,"redis_calls":19,"redis_duration_s":0.006947,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001549,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000534,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003607,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001257,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049976,"duration_s":0.084219,"completed_at":"2026-09-04T07:45:12.384Z","load_balancing_strategy":"primary","db_duration_s":0.003913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.913309] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6859bb7916e88ac82a3fd949","created_at":"2026-09-04T07:45:10.914Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f78a1e9efba27f58ae0d57504a87e94f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.967Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6859bb7916e88ac82a3fd949: start","job_status":"start","queue_duration_s":1.418865,"scheduling_latency_s":1.418896} gitlab # [ 280.927433] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.424Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6859bb7916e88ac82a3fd949","created_at":"2026-09-04T07:45:10.914Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f78a1e9efba27f58ae0d57504a87e94f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:10.967Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6859bb7916e88ac82a3fd949: done: 0.037692 sec","job_status":"done","queue_duration_s":1.418865,"scheduling_latency_s":1.418896,"redis_calls":10,"redis_duration_s":0.003171,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00061,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001851,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00071,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004725,"duration_s":0.037692,"completed_at":"2026-09-04T07:45:12.424Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004917,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.971247] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.426Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9120091a5aa231a28ab2e8e1","created_at":"2026-09-04T07:45:11.011Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7101147cf950b8e595467ebbb03f0382","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.038Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9120091a5aa231a28ab2e8e1: start","job_status":"start","queue_duration_s":1.388407,"scheduling_latency_s":1.388443} gitlab # [ 280.986007] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.446Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 280.989226] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.457Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9120091a5aa231a28ab2e8e1","created_at":"2026-09-04T07:45:11.011Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7101147cf950b8e595467ebbb03f0382","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.038Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9120091a5aa231a28ab2e8e1: done: 0.030664 sec","job_status":"done","queue_duration_s":1.388407,"scheduling_latency_s":1.388443,"redis_calls":10,"redis_duration_s":0.003233,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000834,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000616,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043408,"duration_s":0.030664,"completed_at":"2026-09-04T07:45:12.457Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.031781] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5c264f4213065cfb4d5c3b66","created_at":"2026-09-04T07:45:11.112Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df205bc002b4e97f48e3678758b7fd63","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:45:11.139Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5c264f4213065cfb4d5c3b66: start","job_status":"start","queue_duration_s":1.319679,"scheduling_latency_s":1.319707} gitlab # [ 281.045216] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.507Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5c264f4213065cfb4d5c3b66","created_at":"2026-09-04T07:45:11.112Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df205bc002b4e97f48e3678758b7fd63","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:45:11.139Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5c264f4213065cfb4d5c3b66: done: 0.047967 sec","job_status":"done","queue_duration_s":1.319679,"scheduling_latency_s":1.319707,"redis_calls":10,"redis_duration_s":0.0031799999999999997,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000603,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001901,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000676,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047552,"duration_s":0.047967,"completed_at":"2026-09-04T07:45:12.507Z","load_balancing_strategy":"primary","db_duration_s":0.007932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.086695] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.509Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1fc34bfc8a48b43ad7aaf5c4","created_at":"2026-09-04T07:45:11.160Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5ab3c6f8ec05cdfa6a0427404e2aa1a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.177Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1fc34bfc8a48b43ad7aaf5c4: start","job_status":"start","queue_duration_s":1.331788,"scheduling_latency_s":1.33182} gitlab # [ 281.101276] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.526Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 281.104810] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1fc34bfc8a48b43ad7aaf5c4","created_at":"2026-09-04T07:45:11.160Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5ab3c6f8ec05cdfa6a0427404e2aa1a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.177Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1fc34bfc8a48b43ad7aaf5c4: done: 0.027044 sec","job_status":"done","queue_duration_s":1.331788,"scheduling_latency_s":1.33182,"redis_calls":10,"redis_duration_s":0.002941,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000701,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000556,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040692,"duration_s":0.027044,"completed_at":"2026-09-04T07:45:12.536Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000783,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.147510] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.538Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"f152fe5c0f903ea956c5c228","created_at":"2026-09-04T07:45:11.194Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74fb343beffaad9d97f533719d29f312","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.205Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-f152fe5c0f903ea956c5c228: start","job_status":"start","queue_duration_s":1.332572,"scheduling_latency_s":1.3326} gitlab # [ 281.162990] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.578Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"f152fe5c0f903ea956c5c228","created_at":"2026-09-04T07:45:11.194Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74fb343beffaad9d97f533719d29f312","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.205Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-f152fe5c0f903ea956c5c228: done: 0.039886 sec","job_status":"done","queue_duration_s":1.332572,"scheduling_latency_s":1.3326,"redis_calls":10,"redis_duration_s":0.003052,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000663,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00178,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000609,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036762,"duration_s":0.039886,"completed_at":"2026-09-04T07:45:12.578Z","load_balancing_strategy":"primary","db_duration_s":0.008046,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.205198] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"9c1dd3a8b39829b6ab5a6913","created_at":"2026-09-04T07:45:11.248Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72e94a529f45533a71416285ed78b729","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.276Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-9c1dd3a8b39829b6ab5a6913: start","job_status":"start","queue_duration_s":1.304088,"scheduling_latency_s":1.304109} gitlab # [ 281.220168] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.593Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 281.224025] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.602Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"9c1dd3a8b39829b6ab5a6913","created_at":"2026-09-04T07:45:11.248Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72e94a529f45533a71416285ed78b729","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.276Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-9c1dd3a8b39829b6ab5a6913: done: 0.021849 sec","job_status":"done","queue_duration_s":1.304088,"scheduling_latency_s":1.304109,"redis_calls":10,"redis_duration_s":0.002587,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00063,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001465,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039432,"duration_s":0.021849,"completed_at":"2026-09-04T07:45:12.602Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00066,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.267552] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a89153498c4ccaea2a52efb4","created_at":"2026-09-04T07:45:11.297Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67633d8d05f07e419a510d7badfc31a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.323Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a89153498c4ccaea2a52efb4: start","job_status":"start","queue_duration_s":1.280128,"scheduling_latency_s":1.280146} gitlab # [ 281.282925] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.617Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 281.286500] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a89153498c4ccaea2a52efb4","created_at":"2026-09-04T07:45:11.297Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67633d8d05f07e419a510d7badfc31a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.323Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a89153498c4ccaea2a52efb4: done: 0.021598 sec","job_status":"done","queue_duration_s":1.280128,"scheduling_latency_s":1.280146,"redis_calls":10,"redis_duration_s":0.002683,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00055,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001638,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000495,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034132,"duration_s":0.021598,"completed_at":"2026-09-04T07:45:12.625Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.329638] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.627Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c17543822de6e12401d5f962","created_at":"2026-09-04T07:45:11.387Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b51fba8a8f813acc9511f66cb8f29e0","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.416Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c17543822de6e12401d5f962: start","job_status":"start","queue_duration_s":1.210342,"scheduling_latency_s":1.210361} gitlab # [ 281.372488] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"c17543822de6e12401d5f962","created_at":"2026-09-04T07:45:11.387Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b51fba8a8f813acc9511f66cb8f29e0","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.416Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-c17543822de6e12401d5f962: done: 0.357182 sec","job_status":"done","queue_duration_s":1.210342,"scheduling_latency_s":1.210361,"redis_calls":565,"redis_duration_s":0.091866,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001078,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001285,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.089503,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.301682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026738,"duration_s":0.357182,"completed_at":"2026-09-04T07:45:12.984Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000707,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.416808] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:12.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"039369a22b4296e4f694ac5b","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-039369a22b4296e4f694ac5b: start","job_status":"start","queue_duration_s":1.258132,"scheduling_latency_s":1.258157} gitlab # [ 281.429821] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"039369a22b4296e4f694ac5b","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-039369a22b4296e4f694ac5b: done: 0.027578 sec","job_status":"done","queue_duration_s":1.258132,"scheduling_latency_s":1.258157,"redis_calls":16,"redis_duration_s":0.004299,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000549,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00118,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00257,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034624,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027578,"completed_at":"2026-09-04T07:45:13.013Z","load_balancing_strategy":"primary","db_duration_s":0.000902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.471130] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85936885b6687d924b3f49de","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85936885b6687d924b3f49de: start","job_status":"start","queue_duration_s":1.287592,"scheduling_latency_s":1.287612} gitlab # [ 281.484026] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85936885b6687d924b3f49de","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85936885b6687d924b3f49de: done: 0.025611 sec","job_status":"done","queue_duration_s":1.287592,"scheduling_latency_s":1.287612,"redis_calls":13,"redis_duration_s":0.006883,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025611,"completed_at":"2026-09-04T07:45:13.041Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.523180] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fe5f7d7e73f04dc478678ce","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fe5f7d7e73f04dc478678ce: start","job_status":"start","queue_duration_s":1.315905,"scheduling_latency_s":1.315932} gitlab # [ 281.535814] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fe5f7d7e73f04dc478678ce","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fe5f7d7e73f04dc478678ce: done: 0.028367 sec","job_status":"done","queue_duration_s":1.315905,"scheduling_latency_s":1.315932,"redis_calls":13,"redis_duration_s":0.008808999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007676,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028367,"completed_at":"2026-09-04T07:45:13.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.577310] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26b63dcd3f6f092348b2f81a","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26b63dcd3f6f092348b2f81a: start","job_status":"start","queue_duration_s":1.34595,"scheduling_latency_s":1.345973} gitlab # [ 281.589933] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26b63dcd3f6f092348b2f81a","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26b63dcd3f6f092348b2f81a: done: 0.017945 sec","job_status":"done","queue_duration_s":1.34595,"scheduling_latency_s":1.345973,"redis_calls":13,"redis_duration_s":0.002553,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001753,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017945,"completed_at":"2026-09-04T07:45:13.091Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.629398] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac1bf77ec5d35820c925a0e8","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac1bf77ec5d35820c925a0e8: start","job_status":"start","queue_duration_s":1.365438,"scheduling_latency_s":1.365462} gitlab # [ 281.641914] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac1bf77ec5d35820c925a0e8","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac1bf77ec5d35820c925a0e8: done: 0.016874 sec","job_status":"done","queue_duration_s":1.365438,"scheduling_latency_s":1.365462,"redis_calls":13,"redis_duration_s":0.001922,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016874,"completed_at":"2026-09-04T07:45:13.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.681494] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca5baf177c1dd8a3c173b478","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca5baf177c1dd8a3c173b478: start","job_status":"start","queue_duration_s":1.38365,"scheduling_latency_s":1.383671} gitlab # [ 281.693732] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca5baf177c1dd8a3c173b478","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca5baf177c1dd8a3c173b478: done: 0.017834 sec","job_status":"done","queue_duration_s":1.38365,"scheduling_latency_s":1.383671,"redis_calls":13,"redis_duration_s":0.002258,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000752,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001506,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017834,"completed_at":"2026-09-04T07:45:13.129Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.734007] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"719c0ec298d26d622d287c37","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-719c0ec298d26d622d287c37: start","job_status":"start","queue_duration_s":1.40289,"scheduling_latency_s":1.402911} gitlab # [ 281.746837] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"719c0ec298d26d622d287c37","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-719c0ec298d26d622d287c37: done: 0.018561 sec","job_status":"done","queue_duration_s":1.40289,"scheduling_latency_s":1.402911,"redis_calls":13,"redis_duration_s":0.0023769999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001588,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018561,"completed_at":"2026-09-04T07:45:13.149Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.788559] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1b1f0019e4968af6e97a2f4","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1b1f0019e4968af6e97a2f4: start","job_status":"start","queue_duration_s":1.422875,"scheduling_latency_s":1.422895} gitlab # [ 281.801378] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1b1f0019e4968af6e97a2f4","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1b1f0019e4968af6e97a2f4: done: 0.018238 sec","job_status":"done","queue_duration_s":1.422875,"scheduling_latency_s":1.422895,"redis_calls":13,"redis_duration_s":0.002114,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018238,"completed_at":"2026-09-04T07:45:13.169Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.841279] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a72cd9c02e8580f447fbe1a3","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a72cd9c02e8580f447fbe1a3: start","job_status":"start","queue_duration_s":1.442587,"scheduling_latency_s":1.442609} gitlab # [ 281.853990] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a72cd9c02e8580f447fbe1a3","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a72cd9c02e8580f447fbe1a3: done: 0.017869 sec","job_status":"done","queue_duration_s":1.442587,"scheduling_latency_s":1.442609,"redis_calls":13,"redis_duration_s":0.002151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001368,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017869,"completed_at":"2026-09-04T07:45:13.188Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.893927] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e192e2392836c742e5170c34","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e192e2392836c742e5170c34: start","job_status":"start","queue_duration_s":1.462001,"scheduling_latency_s":1.462022} gitlab # [ 281.906811] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e192e2392836c742e5170c34","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e192e2392836c742e5170c34: done: 0.01735 sec","job_status":"done","queue_duration_s":1.462001,"scheduling_latency_s":1.462022,"redis_calls":13,"redis_duration_s":0.00232,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01735,"completed_at":"2026-09-04T07:45:13.207Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.946121] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2284cf20e9cbf7760028f30e","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2284cf20e9cbf7760028f30e: start","job_status":"start","queue_duration_s":1.480907,"scheduling_latency_s":1.480926} gitlab # [ 281.958770] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2284cf20e9cbf7760028f30e","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2284cf20e9cbf7760028f30e: done: 0.015748 sec","job_status":"done","queue_duration_s":1.480907,"scheduling_latency_s":1.480926,"redis_calls":13,"redis_duration_s":0.0016159999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015748,"completed_at":"2026-09-04T07:45:13.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.000436] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c940d7c9db1cb326650d53aa","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c940d7c9db1cb326650d53aa: start","job_status":"start","queue_duration_s":1.498144,"scheduling_latency_s":1.498161} gitlab # [ 282.012942] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c940d7c9db1cb326650d53aa","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c940d7c9db1cb326650d53aa: done: 0.016147 sec","job_status":"done","queue_duration_s":1.498144,"scheduling_latency_s":1.498161,"redis_calls":13,"redis_duration_s":0.0016610000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016147,"completed_at":"2026-09-04T07:45:13.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.052878] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab9b58ecde8e8465c0f39b89","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab9b58ecde8e8465c0f39b89: start","job_status":"start","queue_duration_s":1.515649,"scheduling_latency_s":1.515667} gitlab # [ 282.065517] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab9b58ecde8e8465c0f39b89","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab9b58ecde8e8465c0f39b89: done: 0.015709 sec","job_status":"done","queue_duration_s":1.515649,"scheduling_latency_s":1.515667,"redis_calls":13,"redis_duration_s":0.001657,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015709,"completed_at":"2026-09-04T07:45:13.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.105205] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66b49b4f7018f481cc4a9627","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66b49b4f7018f481cc4a9627: start","job_status":"start","queue_duration_s":1.532796,"scheduling_latency_s":1.532816} gitlab # [ 282.117828] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66b49b4f7018f481cc4a9627","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66b49b4f7018f481cc4a9627: done: 0.015868 sec","job_status":"done","queue_duration_s":1.532796,"scheduling_latency_s":1.532816,"redis_calls":13,"redis_duration_s":0.001709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015868,"completed_at":"2026-09-04T07:45:13.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.157355] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be63e9c31b1700fc17e84bfa","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be63e9c31b1700fc17e84bfa: start","job_status":"start","queue_duration_s":1.550122,"scheduling_latency_s":1.55014} gitlab # [ 282.169939] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be63e9c31b1700fc17e84bfa","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be63e9c31b1700fc17e84bfa: done: 0.016189 sec","job_status":"done","queue_duration_s":1.550122,"scheduling_latency_s":1.55014,"redis_calls":13,"redis_duration_s":0.001699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016189,"completed_at":"2026-09-04T07:45:13.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.211288] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34c5ac46ea3794b29e433093","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34c5ac46ea3794b29e433093: start","job_status":"start","queue_duration_s":1.56753,"scheduling_latency_s":1.567554} gitlab # [ 282.223867] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34c5ac46ea3794b29e433093","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34c5ac46ea3794b29e433093: done: 0.016695 sec","job_status":"done","queue_duration_s":1.56753,"scheduling_latency_s":1.567554,"redis_calls":13,"redis_duration_s":0.001854,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016695,"completed_at":"2026-09-04T07:45:13.312Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.263337] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08bf91a74598ef2ecbb83dda","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08bf91a74598ef2ecbb83dda: start","job_status":"start","queue_duration_s":1.58552,"scheduling_latency_s":1.585557} gitlab # [ 282.275888] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08bf91a74598ef2ecbb83dda","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08bf91a74598ef2ecbb83dda: done: 0.016966 sec","job_status":"done","queue_duration_s":1.58552,"scheduling_latency_s":1.585557,"redis_calls":13,"redis_duration_s":0.001834,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000658,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016966,"completed_at":"2026-09-04T07:45:13.330Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.315893] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54d3f039fd980705681e7f06","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54d3f039fd980705681e7f06: start","job_status":"start","queue_duration_s":1.605689,"scheduling_latency_s":1.605709} gitlab # [ 282.328642] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54d3f039fd980705681e7f06","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54d3f039fd980705681e7f06: done: 0.021856 sec","job_status":"done","queue_duration_s":1.605689,"scheduling_latency_s":1.605709,"redis_calls":13,"redis_duration_s":0.002184,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001222,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021856,"completed_at":"2026-09-04T07:45:13.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.368962] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad9792f23ced9d6bb528be97","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad9792f23ced9d6bb528be97: start","job_status":"start","queue_duration_s":1.628912,"scheduling_latency_s":1.628931} gitlab # [ 282.382741] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad9792f23ced9d6bb528be97","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad9792f23ced9d6bb528be97: done: 0.017451 sec","job_status":"done","queue_duration_s":1.628912,"scheduling_latency_s":1.628931,"redis_calls":13,"redis_duration_s":0.002098,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001411,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017451,"completed_at":"2026-09-04T07:45:13.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.421997] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd274db1f59c3075e1c0f6b6","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd274db1f59c3075e1c0f6b6: start","job_status":"start","queue_duration_s":1.647688,"scheduling_latency_s":1.647708} gitlab # [ 282.434958] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd274db1f59c3075e1c0f6b6","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd274db1f59c3075e1c0f6b6: done: 0.019442 sec","job_status":"done","queue_duration_s":1.647688,"scheduling_latency_s":1.647708,"redis_calls":13,"redis_duration_s":0.0023769999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001432,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019442,"completed_at":"2026-09-04T07:45:13.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.474370] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a690929f8299e2667b19a374","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a690929f8299e2667b19a374: start","job_status":"start","queue_duration_s":1.668564,"scheduling_latency_s":1.668592} gitlab # [ 282.487085] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a690929f8299e2667b19a374","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a690929f8299e2667b19a374: done: 0.019206 sec","job_status":"done","queue_duration_s":1.668564,"scheduling_latency_s":1.668592,"redis_calls":13,"redis_duration_s":0.0018419999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019206,"completed_at":"2026-09-04T07:45:13.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.526757] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0c40b917579df77d4c8feea","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0c40b917579df77d4c8feea: start","job_status":"start","queue_duration_s":1.689047,"scheduling_latency_s":1.689065} gitlab # [ 282.539299] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0c40b917579df77d4c8feea","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0c40b917579df77d4c8feea: done: 0.015436 sec","job_status":"done","queue_duration_s":1.689047,"scheduling_latency_s":1.689065,"redis_calls":13,"redis_duration_s":0.001547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015436,"completed_at":"2026-09-04T07:45:13.432Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.578295] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c04a4476ba7cd259c4ae5ec","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c04a4476ba7cd259c4ae5ec: start","job_status":"start","queue_duration_s":1.705828,"scheduling_latency_s":1.705846} gitlab # [ 282.592430] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c04a4476ba7cd259c4ae5ec","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c04a4476ba7cd259c4ae5ec: done: 0.01612 sec","job_status":"done","queue_duration_s":1.705828,"scheduling_latency_s":1.705846,"redis_calls":13,"redis_duration_s":0.0015960000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01612,"completed_at":"2026-09-04T07:45:13.449Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.632369] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b29ff2f5f01f364ddba3fe0","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b29ff2f5f01f364ddba3fe0: start","job_status":"start","queue_duration_s":1.723353,"scheduling_latency_s":1.723372} gitlab # [ 282.644981] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b29ff2f5f01f364ddba3fe0","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b29ff2f5f01f364ddba3fe0: done: 0.01592 sec","job_status":"done","queue_duration_s":1.723353,"scheduling_latency_s":1.723372,"redis_calls":13,"redis_duration_s":0.001618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01592,"completed_at":"2026-09-04T07:45:13.467Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.684404] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18b323abd2c30cd31daeed82","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18b323abd2c30cd31daeed82: start","job_status":"start","queue_duration_s":1.740702,"scheduling_latency_s":1.740721} gitlab # [ 282.696741] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18b323abd2c30cd31daeed82","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18b323abd2c30cd31daeed82: done: 0.016345 sec","job_status":"done","queue_duration_s":1.740702,"scheduling_latency_s":1.740721,"redis_calls":13,"redis_duration_s":0.001715,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016345,"completed_at":"2026-09-04T07:45:13.484Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.736087] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b975af0dceda38c5f722e41","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b975af0dceda38c5f722e41: start","job_status":"start","queue_duration_s":1.758454,"scheduling_latency_s":1.758472} gitlab # [ 282.748468] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b975af0dceda38c5f722e41","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b975af0dceda38c5f722e41: done: 0.016786 sec","job_status":"done","queue_duration_s":1.758454,"scheduling_latency_s":1.758472,"redis_calls":13,"redis_duration_s":0.001843,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016786,"completed_at":"2026-09-04T07:45:13.503Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.789501] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56a9dbe0f831dae7f85e03b6","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56a9dbe0f831dae7f85e03b6: start","job_status":"start","queue_duration_s":1.776742,"scheduling_latency_s":1.776762} gitlab # [ 282.802126] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.521Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56a9dbe0f831dae7f85e03b6","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56a9dbe0f831dae7f85e03b6: done: 0.016766 sec","job_status":"done","queue_duration_s":1.776742,"scheduling_latency_s":1.776762,"redis_calls":13,"redis_duration_s":0.001817,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016766,"completed_at":"2026-09-04T07:45:13.521Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.841040] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d2248a6d9234607d37f4ce4","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d2248a6d9234607d37f4ce4: start","job_status":"start","queue_duration_s":1.795045,"scheduling_latency_s":1.795063} gitlab # [ 282.853339] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d2248a6d9234607d37f4ce4","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d2248a6d9234607d37f4ce4: done: 0.01696 sec","job_status":"done","queue_duration_s":1.795045,"scheduling_latency_s":1.795063,"redis_calls":13,"redis_duration_s":0.00183,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01696,"completed_at":"2026-09-04T07:45:13.539Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.892646] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"632bcfa56a2b341231782dae","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-632bcfa56a2b341231782dae: start","job_status":"start","queue_duration_s":1.813371,"scheduling_latency_s":1.813389} gitlab # [ 282.905079] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"632bcfa56a2b341231782dae","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-632bcfa56a2b341231782dae: done: 0.01795 sec","job_status":"done","queue_duration_s":1.813371,"scheduling_latency_s":1.813389,"redis_calls":13,"redis_duration_s":0.0020239999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001361,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01795,"completed_at":"2026-09-04T07:45:13.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.944950] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0c409f891b47c6d2378d885","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0c409f891b47c6d2378d885: start","job_status":"start","queue_duration_s":1.832697,"scheduling_latency_s":1.832715} gitlab # [ 282.957396] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0c409f891b47c6d2378d885","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0c409f891b47c6d2378d885: done: 0.01715 sec","job_status":"done","queue_duration_s":1.832697,"scheduling_latency_s":1.832715,"redis_calls":13,"redis_duration_s":0.001835,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001157,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01715,"completed_at":"2026-09-04T07:45:13.577Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.998534] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1048eaa0b86d9f7964b9e0f2","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1048eaa0b86d9f7964b9e0f2: start","job_status":"start","queue_duration_s":1.851084,"scheduling_latency_s":1.851102} gitlab # [ 283.011320] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1048eaa0b86d9f7964b9e0f2","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1048eaa0b86d9f7964b9e0f2: done: 0.016914 sec","job_status":"done","queue_duration_s":1.851084,"scheduling_latency_s":1.851102,"redis_calls":13,"redis_duration_s":0.0017100000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016914,"completed_at":"2026-09-04T07:45:13.595Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.051603] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8fc905306538d8e58c80d7b","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8fc905306538d8e58c80d7b: start","job_status":"start","queue_duration_s":1.869255,"scheduling_latency_s":1.869276} gitlab # [ 283.064430] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8fc905306538d8e58c80d7b","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8fc905306538d8e58c80d7b: done: 0.015871 sec","job_status":"done","queue_duration_s":1.869255,"scheduling_latency_s":1.869276,"redis_calls":13,"redis_duration_s":0.001556,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015871,"completed_at":"2026-09-04T07:45:13.613Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.103971] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6ae432b6c065f927328e8bc","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6ae432b6c065f927328e8bc: start","job_status":"start","queue_duration_s":1.886276,"scheduling_latency_s":1.886292} gitlab # [ 283.117334] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6ae432b6c065f927328e8bc","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6ae432b6c065f927328e8bc: done: 0.01564 sec","job_status":"done","queue_duration_s":1.886276,"scheduling_latency_s":1.886292,"redis_calls":13,"redis_duration_s":0.001575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01564,"completed_at":"2026-09-04T07:45:13.629Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.157162] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a620de9c263fecefdb53f6f","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a620de9c263fecefdb53f6f: start","job_status":"start","queue_duration_s":1.903297,"scheduling_latency_s":1.903319} gitlab # [ 283.169809] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a620de9c263fecefdb53f6f","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a620de9c263fecefdb53f6f: done: 0.016606 sec","job_status":"done","queue_duration_s":1.903297,"scheduling_latency_s":1.903319,"redis_calls":13,"redis_duration_s":0.001692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016606,"completed_at":"2026-09-04T07:45:13.647Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.210977] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b8c196f135ad8751a3a237d","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b8c196f135ad8751a3a237d: start","job_status":"start","queue_duration_s":1.921353,"scheduling_latency_s":1.921372} gitlab # [ 283.223898] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b8c196f135ad8751a3a237d","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b8c196f135ad8751a3a237d: done: 0.015811 sec","job_status":"done","queue_duration_s":1.921353,"scheduling_latency_s":1.921372,"redis_calls":13,"redis_duration_s":0.001803,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015811,"completed_at":"2026-09-04T07:45:13.665Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.263799] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97e6000145cb08b40e17531e","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97e6000145cb08b40e17531e: start","job_status":"start","queue_duration_s":1.938622,"scheduling_latency_s":1.93864} gitlab # [ 283.276232] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97e6000145cb08b40e17531e","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97e6000145cb08b40e17531e: done: 0.015933 sec","job_status":"done","queue_duration_s":1.938622,"scheduling_latency_s":1.93864,"redis_calls":13,"redis_duration_s":0.00183,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001251,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015933,"completed_at":"2026-09-04T07:45:13.682Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.314118] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.684Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32db243611324d17c095da00","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32db243611324d17c095da00: start","job_status":"start","queue_duration_s":1.956013,"scheduling_latency_s":1.95603} gitlab # [ 283.326770] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32db243611324d17c095da00","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32db243611324d17c095da00: done: 0.016537 sec","job_status":"done","queue_duration_s":1.956013,"scheduling_latency_s":1.95603,"redis_calls":13,"redis_duration_s":0.0017439999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016537,"completed_at":"2026-09-04T07:45:13.700Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.365091] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fbc0185c41c8dac2725b5f3","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fbc0185c41c8dac2725b5f3: start","job_status":"start","queue_duration_s":1.973846,"scheduling_latency_s":1.973864} gitlab # [ 283.377217] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fbc0185c41c8dac2725b5f3","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fbc0185c41c8dac2725b5f3: done: 0.016736 sec","job_status":"done","queue_duration_s":1.973846,"scheduling_latency_s":1.973864,"redis_calls":13,"redis_duration_s":0.001746,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016736,"completed_at":"2026-09-04T07:45:13.718Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.416969] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12d24e6039fcc61643dc55f0","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12d24e6039fcc61643dc55f0: start","job_status":"start","queue_duration_s":1.991937,"scheduling_latency_s":1.991955} gitlab # [ 283.442120] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12d24e6039fcc61643dc55f0","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12d24e6039fcc61643dc55f0: done: 0.016869 sec","job_status":"done","queue_duration_s":1.991937,"scheduling_latency_s":1.991955,"redis_calls":13,"redis_duration_s":0.001865,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016869,"completed_at":"2026-09-04T07:45:13.736Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.496295] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f4b463ada9fd611eddce0c5","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f4b463ada9fd611eddce0c5: start","job_status":"start","queue_duration_s":2.010146,"scheduling_latency_s":2.010165} gitlab # [ 283.509339] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.755Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f4b463ada9fd611eddce0c5","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f4b463ada9fd611eddce0c5: done: 0.017183 sec","job_status":"done","queue_duration_s":2.010146,"scheduling_latency_s":2.010165,"redis_calls":13,"redis_duration_s":0.002047,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001404,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017183,"completed_at":"2026-09-04T07:45:13.755Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.548590] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50c30d919f0aa3e0233de832","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50c30d919f0aa3e0233de832: start","job_status":"start","queue_duration_s":2.0288,"scheduling_latency_s":2.028819} gitlab # [ 283.560849] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50c30d919f0aa3e0233de832","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50c30d919f0aa3e0233de832: done: 0.015446 sec","job_status":"done","queue_duration_s":2.0288,"scheduling_latency_s":2.028819,"redis_calls":13,"redis_duration_s":0.0015369999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015446,"completed_at":"2026-09-04T07:45:13.772Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.600243] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e67452726ec27daf742b9c3a","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e67452726ec27daf742b9c3a: start","job_status":"start","queue_duration_s":2.045399,"scheduling_latency_s":2.045416} gitlab # [ 283.613700] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e67452726ec27daf742b9c3a","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e67452726ec27daf742b9c3a: done: 0.015522 sec","job_status":"done","queue_duration_s":2.045399,"scheduling_latency_s":2.045416,"redis_calls":13,"redis_duration_s":0.001741,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015522,"completed_at":"2026-09-04T07:45:13.788Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.652623] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42436144c0f726f365fceed4","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42436144c0f726f365fceed4: start","job_status":"start","queue_duration_s":2.06213,"scheduling_latency_s":2.062146} gitlab # [ 283.664889] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42436144c0f726f365fceed4","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42436144c0f726f365fceed4: done: 0.015676 sec","job_status":"done","queue_duration_s":2.06213,"scheduling_latency_s":2.062146,"redis_calls":13,"redis_duration_s":0.0016389999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015676,"completed_at":"2026-09-04T07:45:13.805Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.704488] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b2e088f3f551ebb90543fc2","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b2e088f3f551ebb90543fc2: start","job_status":"start","queue_duration_s":2.079212,"scheduling_latency_s":2.07923} gitlab # [ 283.716699] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b2e088f3f551ebb90543fc2","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b2e088f3f551ebb90543fc2: done: 0.016678 sec","job_status":"done","queue_duration_s":2.079212,"scheduling_latency_s":2.07923,"redis_calls":13,"redis_duration_s":0.0017269999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016678,"completed_at":"2026-09-04T07:45:13.823Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.755982] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcf79d722d55143e3d2f6042","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcf79d722d55143e3d2f6042: start","job_status":"start","queue_duration_s":2.097416,"scheduling_latency_s":2.097435} gitlab # [ 283.768072] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fcf79d722d55143e3d2f6042","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fcf79d722d55143e3d2f6042: done: 0.016564 sec","job_status":"done","queue_duration_s":2.097416,"scheduling_latency_s":2.097435,"redis_calls":13,"redis_duration_s":0.0018219999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016564,"completed_at":"2026-09-04T07:45:13.841Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.808398] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"169a6ce7259ffdeb5cb8bfc1","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-169a6ce7259ffdeb5cb8bfc1: start","job_status":"start","queue_duration_s":2.115537,"scheduling_latency_s":2.115556} gitlab # [ 283.820615] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"169a6ce7259ffdeb5cb8bfc1","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-169a6ce7259ffdeb5cb8bfc1: done: 0.016891 sec","job_status":"done","queue_duration_s":2.115537,"scheduling_latency_s":2.115556,"redis_calls":13,"redis_duration_s":0.001827,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00064,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016891,"completed_at":"2026-09-04T07:45:13.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.860683] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c6c6fa89564a330f0bcd7c5","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c6c6fa89564a330f0bcd7c5: start","job_status":"start","queue_duration_s":2.134084,"scheduling_latency_s":2.134104} gitlab # [ 283.897749] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c6c6fa89564a330f0bcd7c5","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c6c6fa89564a330f0bcd7c5: done: 0.016827 sec","job_status":"done","queue_duration_s":2.134084,"scheduling_latency_s":2.134104,"redis_calls":13,"redis_duration_s":0.0018349999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016827,"completed_at":"2026-09-04T07:45:13.878Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.968750] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daec74aaf2a3b1d62f006fa5","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daec74aaf2a3b1d62f006fa5: start","job_status":"start","queue_duration_s":2.152403,"scheduling_latency_s":2.152423} gitlab # [ 283.982994] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daec74aaf2a3b1d62f006fa5","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daec74aaf2a3b1d62f006fa5: done: 0.016659 sec","job_status":"done","queue_duration_s":2.152403,"scheduling_latency_s":2.152423,"redis_calls":13,"redis_duration_s":0.001865,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001218,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016659,"completed_at":"2026-09-04T07:45:13.896Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.022526] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a148d64ebd96002ed98b852","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a148d64ebd96002ed98b852: start","job_status":"start","queue_duration_s":2.170394,"scheduling_latency_s":2.170413} gitlab # [ 284.036111] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a148d64ebd96002ed98b852","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a148d64ebd96002ed98b852: done: 0.017222 sec","job_status":"done","queue_duration_s":2.170394,"scheduling_latency_s":2.170413,"redis_calls":13,"redis_duration_s":0.002081,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017222,"completed_at":"2026-09-04T07:45:13.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.075483] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aceed88a3eeece21fdd8c309","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aceed88a3eeece21fdd8c309: start","job_status":"start","queue_duration_s":2.188946,"scheduling_latency_s":2.188965} gitlab # [ 284.088169] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aceed88a3eeece21fdd8c309","created_at":"2026-09-04T07:45:11.602Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-3b68f15d18234e73","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3b06cf9dc9b79eb21a371f94f424db55","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:11.728Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aceed88a3eeece21fdd8c309: done: 0.017217 sec","job_status":"done","queue_duration_s":2.188946,"scheduling_latency_s":2.188965,"redis_calls":13,"redis_duration_s":0.002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000669,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001331,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017217,"completed_at":"2026-09-04T07:45:13.934Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.127416] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.935Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2acaf014377f56a5a4bece7b","created_at":"2026-09-04T07:45:12.342Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-e1f9e0b841f048bb","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5ce42897034e2e594209a0430f3be524","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:12.370Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2acaf014377f56a5a4bece7b: start","job_status":"start","queue_duration_s":1.564369,"scheduling_latency_s":1.564386} gitlab # [ 284.139693] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.955Z","message":"No existing merge request to be cleaned up."} gitlab # [ 284.141414] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.973Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2acaf014377f56a5a4bece7b","created_at":"2026-09-04T07:45:12.342Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-e1f9e0b841f048bb","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5ce42897034e2e594209a0430f3be524","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:12.370Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2acaf014377f56a5a4bece7b: done: 0.037975 sec","job_status":"done","queue_duration_s":1.564369,"scheduling_latency_s":1.564386,"redis_calls":13,"redis_duration_s":0.001971,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000306,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026974,"duration_s":0.037975,"completed_at":"2026-09-04T07:45:13.973Z","load_balancing_strategy":"primary","db_duration_s":0.007272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.181195] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.974Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"168a6cef039958f1e8c9d478","created_at":"2026-09-04T07:45:12.342Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-e1f9e0b841f048bb","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5ce42897034e2e594209a0430f3be524","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:12.370Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-168a6cef039958f1e8c9d478: start","job_status":"start","queue_duration_s":1.603915,"scheduling_latency_s":1.603937} gitlab # [ 284.193279] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.987Z","message":"No existing merge request to be cleaned up."} gitlab # [ 284.194937] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.998Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"168a6cef039958f1e8c9d478","created_at":"2026-09-04T07:45:12.342Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-e1f9e0b841f048bb","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5ce42897034e2e594209a0430f3be524","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:12.370Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-168a6cef039958f1e8c9d478: done: 0.023311 sec","job_status":"done","queue_duration_s":1.603915,"scheduling_latency_s":1.603937,"redis_calls":10,"redis_duration_s":0.0016510000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023311,"completed_at":"2026-09-04T07:45:13.998Z","load_balancing_strategy":"primary","db_duration_s":0.003085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.235304] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:13.999Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1b3cc640a766fa47c1d37852","created_at":"2026-09-04T07:45:12.342Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-e1f9e0b841f048bb","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5ce42897034e2e594209a0430f3be524","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:12.370Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1b3cc640a766fa47c1d37852: start","job_status":"start","queue_duration_s":1.628518,"scheduling_latency_s":1.628539} gitlab # [ 284.247927] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:14.012Z","message":"No existing merge request to be cleaned up."} gitlab # [ 284.249790] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:14.022Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1b3cc640a766fa47c1d37852","created_at":"2026-09-04T07:45:12.342Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-e1f9e0b841f048bb","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5ce42897034e2e594209a0430f3be524","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:12.370Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1b3cc640a766fa47c1d37852: done: 0.022835 sec","job_status":"done","queue_duration_s":1.628518,"scheduling_latency_s":1.628539,"redis_calls":10,"redis_duration_s":0.00174,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022835,"completed_at":"2026-09-04T07:45:14.022Z","load_balancing_strategy":"primary","db_duration_s":0.002768,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.288992] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:14.023Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4451f582051d0fe34293bf6c","created_at":"2026-09-04T07:45:12.342Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-e1f9e0b841f048bb","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5ce42897034e2e594209a0430f3be524","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:12.370Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4451f582051d0fe34293bf6c: start","job_status":"start","queue_duration_s":1.652781,"scheduling_latency_s":1.6528} gitlab # [ 284.301513] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:14.036Z","message":"No existing merge request to be cleaned up."} gitlab # [ 284.303248] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:45:14.048Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4451f582051d0fe34293bf6c","created_at":"2026-09-04T07:45:12.342Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-e1f9e0b841f048bb","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5ce42897034e2e594209a0430f3be524","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:12.370Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4451f582051d0fe34293bf6c: done: 0.024674 sec","job_status":"done","queue_duration_s":1.652781,"scheduling_latency_s":1.6528,"redis_calls":10,"redis_duration_s":0.0018310000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024674,"completed_at":"2026-09-04T07:45:14.048Z","load_balancing_strategy":"primary","db_duration_s":0.002691,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 311.430726] redis[786]: 10 changes in 300 seconds. Saving... gitlab # [ 311.437575] redis[786]: Background saving started by pid 3459 gitlab # [ 311.441636] redis[3459]: BGSAVE done, 430 keys saved, 0 keys skipped, 113937 bytes written. gitlab # [ 311.446089] redis[3459]: DB saved on disk gitlab # [ 311.448378] redis[3459]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB gitlab # [ 311.532632] redis[786]: Background saving terminated with success gitlab # [ 313.488337] postgres[862]: [862] LOG: checkpoint starting: time gitlab # [ 314.379084] gitaly[899]: time="2026-09-04T07:45:45.988Z" level=info msg="burden monitor stats" pid=899 gitlab # [ 325.574056] setup-gitlab-start[3313]: W, [2026-09-04T07:45:57.185265 #3313] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 332.997241] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:04.607Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9b9f9a253e8ceda3c0f09c06","created_at":"2026-09-04T07:46:04.588Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa17c4b6244f099a97ab66498e2378c5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.603Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9b9f9a253e8ceda3c0f09c06: start","job_status":"start","queue_duration_s":0.00382,"scheduling_latency_s":0.003878} gitlab # [ 333.231280] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:04.842Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9b9f9a253e8ceda3c0f09c06","created_at":"2026-09-04T07:46:04.588Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa17c4b6244f099a97ab66498e2378c5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.603Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9b9f9a253e8ceda3c0f09c06: done: 0.234782 sec","job_status":"done","queue_duration_s":0.00382,"scheduling_latency_s":0.003878,"redis_calls":14,"redis_duration_s":0.029371,"redis_read_bytes":901,"redis_write_bytes":1275,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.012914,"redis_feature_flag_read_bytes":896,"redis_feature_flag_write_bytes":449,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012192,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.234782,"completed_at":"2026-09-04T07:46:04.842Z","load_balancing_strategy":"primary","db_duration_s":0.034143,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 333.318170] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:04.847Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"049f0b0bc3dd2bbeeac7e30a","created_at":"2026-09-04T07:46:04.616Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ad367a4188d3c04c50e4b165177ca0b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.624Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-049f0b0bc3dd2bbeeac7e30a: start","job_status":"start","queue_duration_s":0.222698,"scheduling_latency_s":0.222758} gitlab # [ 333.479491] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.090Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"049f0b0bc3dd2bbeeac7e30a","created_at":"2026-09-04T07:46:04.616Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4ad367a4188d3c04c50e4b165177ca0b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.624Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-049f0b0bc3dd2bbeeac7e30a: done: 0.243385 sec","job_status":"done","queue_duration_s":0.222698,"scheduling_latency_s":0.222758,"redis_calls":9,"redis_duration_s":0.008143000000000001,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004622,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003521,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.068,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.068,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0017188,"exclusive_lock_hold_duration_s":0.16535132,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.243385,"completed_at":"2026-09-04T07:46:05.090Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.146637,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 333.575038] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.141Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"9310a14bb70983ecbc9190b0","created_at":"2026-09-04T07:46:04.645Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ace408db3a670bb904ca4664d97b121","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.653Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-9310a14bb70983ecbc9190b0: start","job_status":"start","queue_duration_s":0.487377,"scheduling_latency_s":0.487448} gitlab # [ 333.826000] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"9310a14bb70983ecbc9190b0","created_at":"2026-09-04T07:46:04.645Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ace408db3a670bb904ca4664d97b121","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.653Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-9310a14bb70983ecbc9190b0: done: 0.295905 sec","job_status":"done","queue_duration_s":0.487377,"scheduling_latency_s":0.487448,"redis_calls":10,"redis_duration_s":0.019158,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012716,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006442,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.146301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01860774,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.295905,"completed_at":"2026-09-04T07:46:05.437Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011904,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 333.921928] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.458Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"244ab011214a8e2f7948c95a","created_at":"2026-09-04T07:46:04.691Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59502fb448c66664546b83d0f42f144f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.697Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-244ab011214a8e2f7948c95a: start","job_status":"start","queue_duration_s":0.761103,"scheduling_latency_s":0.76117} gitlab # [ 334.001161] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.611Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"244ab011214a8e2f7948c95a","created_at":"2026-09-04T07:46:04.691Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59502fb448c66664546b83d0f42f144f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.697Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-244ab011214a8e2f7948c95a: done: 0.153153 sec","job_status":"done","queue_duration_s":0.761103,"scheduling_latency_s":0.76117,"redis_calls":7,"redis_duration_s":0.051337,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.048983,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002354,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.153153,"completed_at":"2026-09-04T07:46:05.611Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 334.080388] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.615Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"39b99a5c1e63b82abf99920f","created_at":"2026-09-04T07:46:04.710Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"394d6f7579b30cfee55d4f977a2a127d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.741Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-39b99a5c1e63b82abf99920f: start","job_status":"start","queue_duration_s":0.87376,"scheduling_latency_s":0.8738} gitlab # [ 334.097441] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.682Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"39b99a5c1e63b82abf99920f","created_at":"2026-09-04T07:46:04.710Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"394d6f7579b30cfee55d4f977a2a127d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.741Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-39b99a5c1e63b82abf99920f: done: 0.067192 sec","job_status":"done","queue_duration_s":0.87376,"scheduling_latency_s":0.8738,"redis_calls":12,"redis_duration_s":0.007258,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000943,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004235,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00208,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00156,"exclusive_lock_hold_duration_s":0.0141946,"duration_s":0.067192,"completed_at":"2026-09-04T07:46:05.682Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 334.141529] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.685Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4aabe7aea4ae76098ca30888","created_at":"2026-09-04T07:46:04.796Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8625d1069644898ac33dcb868e16d06d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.813Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4aabe7aea4ae76098ca30888: start","job_status":"start","queue_duration_s":0.872113,"scheduling_latency_s":0.872162} gitlab # [ 334.156654] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.715Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4aabe7aea4ae76098ca30888","created_at":"2026-09-04T07:46:04.796Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8625d1069644898ac33dcb868e16d06d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.813Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4aabe7aea4ae76098ca30888: done: 0.030002 sec","job_status":"done","queue_duration_s":0.872113,"scheduling_latency_s":0.872162,"redis_calls":8,"redis_duration_s":0.003277,"redis_read_bytes":133,"redis_write_bytes":846,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000233,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002443,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000601,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030002,"completed_at":"2026-09-04T07:46:05.715Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 334.200666] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.717Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9b3f788e80cac6585b0ead49","created_at":"2026-09-04T07:46:04.832Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a8663df850a7861570b5597e30b435c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:46:04.839Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9b3f788e80cac6585b0ead49: start","job_status":"start","queue_duration_s":0.878455,"scheduling_latency_s":0.878488} gitlab # [ 334.216076] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.729Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 334.219838] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9b3f788e80cac6585b0ead49","created_at":"2026-09-04T07:46:04.832Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a8663df850a7861570b5597e30b435c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:46:04.839Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9b3f788e80cac6585b0ead49: done: 0.01872 sec","job_status":"done","queue_duration_s":0.878455,"scheduling_latency_s":0.878488,"redis_calls":7,"redis_duration_s":0.001303,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000385,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01872,"completed_at":"2026-09-04T07:46:05.736Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 334.261841] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.738Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9ff6223abfeb548264254a65","created_at":"2026-09-04T07:46:04.883Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.895Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9ff6223abfeb548264254a65: start","job_status":"start","queue_duration_s":0.84268,"scheduling_latency_s":0.842709} gitlab # [ 334.275990] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.856Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9ff6223abfeb548264254a65","created_at":"2026-09-04T07:46:04.883Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.895Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9ff6223abfeb548264254a65: done: 0.118903 sec","job_status":"done","queue_duration_s":0.84268,"scheduling_latency_s":0.842709,"redis_calls":60,"redis_duration_s":0.011242,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.00083,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.009915,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000497,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.118903,"completed_at":"2026-09-04T07:46:05.856Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 334.318226] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"5849aad9fad9ec39b7eb1633","created_at":"2026-09-04T07:46:04.906Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"075d34784530439570151ce7a6bf8476","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.914Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-5849aad9fad9ec39b7eb1633: start","job_status":"start","queue_duration_s":0.945519,"scheduling_latency_s":0.945557} gitlab # [ 334.333601] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.877Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"5849aad9fad9ec39b7eb1633","created_at":"2026-09-04T07:46:04.906Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"075d34784530439570151ce7a6bf8476","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.914Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-5849aad9fad9ec39b7eb1633: done: 0.017941 sec","job_status":"done","queue_duration_s":0.945519,"scheduling_latency_s":0.945557,"redis_calls":7,"redis_duration_s":0.0013,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00037,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017941,"completed_at":"2026-09-04T07:46:05.877Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 334.375432] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.879Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8a343a164a92f13b5402e33a","created_at":"2026-09-04T07:46:04.934Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57f8cefa9bab47a83e0d9cf44bd20fec","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.940Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8a343a164a92f13b5402e33a: start","job_status":"start","queue_duration_s":0.938872,"scheduling_latency_s":0.938901} gitlab # [ 334.389763] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.903Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8a343a164a92f13b5402e33a","created_at":"2026-09-04T07:46:04.934Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57f8cefa9bab47a83e0d9cf44bd20fec","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.940Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8a343a164a92f13b5402e33a: done: 0.024069 sec","job_status":"done","queue_duration_s":0.938872,"scheduling_latency_s":0.938901,"redis_calls":9,"redis_duration_s":0.001865,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065206,"exclusive_lock_hold_duration_s":0.00687288,"duration_s":0.024069,"completed_at":"2026-09-04T07:46:05.903Z","load_balancing_strategy":"primary","db_duration_s":0.002463,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 334.432273] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.905Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"9449d2bb590db5177c944761","created_at":"2026-09-04T07:46:04.948Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3baec9f34b86b99b2c8978fcb92f8bea","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.993Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-9449d2bb590db5177c944761: start","job_status":"start","queue_duration_s":0.911486,"scheduling_latency_s":0.911513} gitlab # [ 334.447580] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.939Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"9449d2bb590db5177c944761","created_at":"2026-09-04T07:46:04.948Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3baec9f34b86b99b2c8978fcb92f8bea","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:04.993Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-9449d2bb590db5177c944761: done: 0.03428 sec","job_status":"done","queue_duration_s":0.911486,"scheduling_latency_s":0.911513,"redis_calls":10,"redis_duration_s":0.001797,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000566,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000353,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027016,"duration_s":0.03428,"completed_at":"2026-09-04T07:46:05.939Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006268,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 334.491093] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:05.940Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5bf390aa99a633a75a712ac8","created_at":"2026-09-04T07:46:05.009Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0164d2a998f0a5c5db5b8f2572851c10","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.015Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5bf390aa99a633a75a712ac8: start","job_status":"start","queue_duration_s":0.925043,"scheduling_latency_s":0.925061} gitlab # [ 334.727648] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"5bf390aa99a633a75a712ac8","created_at":"2026-09-04T07:46:05.009Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0164d2a998f0a5c5db5b8f2572851c10","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.015Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-5bf390aa99a633a75a712ac8: done: 0.398949 sec","job_status":"done","queue_duration_s":0.925043,"scheduling_latency_s":0.925061,"redis_calls":11,"redis_duration_s":0.002465,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000349,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.063,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.322871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00050442,"exclusive_lock_hold_duration_s":0.37770324,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.398949,"completed_at":"2026-09-04T07:46:06.339Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.096015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 334.828453] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.341Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7c438418b6b05ff5c07c5d02","created_at":"2026-09-04T07:46:05.045Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdba94f351d663e647a82e087d06c832","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.053Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7c438418b6b05ff5c07c5d02: start","job_status":"start","queue_duration_s":1.287994,"scheduling_latency_s":1.288018} gitlab # [ 334.852276] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7c438418b6b05ff5c07c5d02","created_at":"2026-09-04T07:46:05.045Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdba94f351d663e647a82e087d06c832","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.053Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7c438418b6b05ff5c07c5d02: done: 0.02159 sec","job_status":"done","queue_duration_s":1.287994,"scheduling_latency_s":1.288018,"redis_calls":9,"redis_duration_s":0.002559,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001245,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062156,"exclusive_lock_hold_duration_s":0.0041177,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.02159,"completed_at":"2026-09-04T07:46:06.362Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002069,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 334.906137] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"859e683bd48eaacd4b3c8fd4","created_at":"2026-09-04T07:46:05.071Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0b7aeae16ac81bb1450877a01c63203","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:46:05.083Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-859e683bd48eaacd4b3c8fd4: start","job_status":"start","queue_duration_s":1.280951,"scheduling_latency_s":1.280975} gitlab # [ 334.920584] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.374Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 334.923939] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.381Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"859e683bd48eaacd4b3c8fd4","created_at":"2026-09-04T07:46:05.071Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0b7aeae16ac81bb1450877a01c63203","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:46:05.083Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-859e683bd48eaacd4b3c8fd4: done: 0.016307 sec","job_status":"done","queue_duration_s":1.280951,"scheduling_latency_s":1.280975,"redis_calls":7,"redis_duration_s":0.0018599999999999999,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000552,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016307,"completed_at":"2026-09-04T07:46:06.380Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 334.965040] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4b159150c803d14cdac5800a","created_at":"2026-09-04T07:46:05.126Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73344c04b323f146a3d27abb904428ab","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.134Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4b159150c803d14cdac5800a: start","job_status":"start","queue_duration_s":1.248005,"scheduling_latency_s":1.248025} gitlab # [ 334.979934] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4b159150c803d14cdac5800a","created_at":"2026-09-04T07:46:05.126Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73344c04b323f146a3d27abb904428ab","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.134Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4b159150c803d14cdac5800a: done: 0.054322 sec","job_status":"done","queue_duration_s":1.248005,"scheduling_latency_s":1.248025,"redis_calls":9,"redis_duration_s":0.003339,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001592,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008918,"exclusive_lock_hold_duration_s":0.02327382,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.054322,"completed_at":"2026-09-04T07:46:06.436Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.025335] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.440Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"fa55c2b1cb57801373d54cd1","created_at":"2026-09-04T07:46:05.140Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52e09b95e4505e1dce92a7eda2a7f5a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.149Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-fa55c2b1cb57801373d54cd1: start","job_status":"start","queue_duration_s":1.290903,"scheduling_latency_s":1.290954} gitlab # [ 335.040581] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.508Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"fa55c2b1cb57801373d54cd1","created_at":"2026-09-04T07:46:05.140Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52e09b95e4505e1dce92a7eda2a7f5a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.149Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-fa55c2b1cb57801373d54cd1: done: 0.06804 sec","job_status":"done","queue_duration_s":1.290903,"scheduling_latency_s":1.290954,"redis_calls":14,"redis_duration_s":0.0051,"redis_read_bytes":16,"redis_write_bytes":4022,"redis_queues_calls":2,"redis_queues_duration_s":0.000497,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003453,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00115,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.06804,"completed_at":"2026-09-04T07:46:06.507Z","load_balancing_strategy":"primary","db_duration_s":0.002092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.082792] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.510Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c2b2be63bed57b0ac1a438e8","created_at":"2026-09-04T07:46:05.164Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8392ad81c4a4533f0e12d0cd7fe85716","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.170Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c2b2be63bed57b0ac1a438e8: start","job_status":"start","queue_duration_s":1.340037,"scheduling_latency_s":1.34008} gitlab # [ 335.097410] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.543Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c2b2be63bed57b0ac1a438e8","created_at":"2026-09-04T07:46:05.164Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8392ad81c4a4533f0e12d0cd7fe85716","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.170Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c2b2be63bed57b0ac1a438e8: done: 0.032604 sec","job_status":"done","queue_duration_s":1.340037,"scheduling_latency_s":1.34008,"redis_calls":7,"redis_duration_s":0.0022329999999999997,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001653,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00058,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032604,"completed_at":"2026-09-04T07:46:06.543Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001861,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.138806] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.545Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c6a63edb880eb09fc37601b4","created_at":"2026-09-04T07:46:05.183Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"782c85dd64972daa9eaf4f6f395aad0b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.188Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c6a63edb880eb09fc37601b4: start","job_status":"start","queue_duration_s":1.356874,"scheduling_latency_s":1.356919} gitlab # [ 335.153833] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.561Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 335.157084] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.572Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c6a63edb880eb09fc37601b4","created_at":"2026-09-04T07:46:05.183Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"782c85dd64972daa9eaf4f6f395aad0b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.188Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c6a63edb880eb09fc37601b4: done: 0.026519 sec","job_status":"done","queue_duration_s":1.356874,"scheduling_latency_s":1.356919,"redis_calls":7,"redis_duration_s":0.002057,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000643,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026519,"completed_at":"2026-09-04T07:46:06.572Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.198533] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.574Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"3de0cd95265f0f7480918be2","created_at":"2026-09-04T07:46:05.200Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb42da78d04eceeba561ff95f8b8ceb8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:46:05.205Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-3de0cd95265f0f7480918be2: start","job_status":"start","queue_duration_s":1.368807,"scheduling_latency_s":1.368844} gitlab # [ 335.212227] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.609Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"3de0cd95265f0f7480918be2","created_at":"2026-09-04T07:46:05.200Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb42da78d04eceeba561ff95f8b8ceb8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:46:05.205Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-3de0cd95265f0f7480918be2: done: 0.034664 sec","job_status":"done","queue_duration_s":1.368807,"scheduling_latency_s":1.368844,"redis_calls":7,"redis_duration_s":0.001775,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034664,"completed_at":"2026-09-04T07:46:06.608Z","load_balancing_strategy":"primary","db_duration_s":0.001996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.254297] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e3960a6c9e75a5caa1203f85","created_at":"2026-09-04T07:46:05.216Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcaae4c895bcefb529c621b3dadcd4a5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.223Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e3960a6c9e75a5caa1203f85: start","job_status":"start","queue_duration_s":1.387131,"scheduling_latency_s":1.387159} gitlab # [ 335.268948] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.618Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 335.272614] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e3960a6c9e75a5caa1203f85","created_at":"2026-09-04T07:46:05.216Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bcaae4c895bcefb529c621b3dadcd4a5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.223Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e3960a6c9e75a5caa1203f85: done: 0.015506 sec","job_status":"done","queue_duration_s":1.387131,"scheduling_latency_s":1.387159,"redis_calls":7,"redis_duration_s":0.001295,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000985,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00031,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015506,"completed_at":"2026-09-04T07:46:06.625Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.313480] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.627Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4a1f64fa02ec8ed27cef5725","created_at":"2026-09-04T07:46:05.234Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"178eb61b589956bb75493487064d0d2b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.239Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4a1f64fa02ec8ed27cef5725: start","job_status":"start","queue_duration_s":1.387932,"scheduling_latency_s":1.387958} gitlab # [ 335.328345] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.636Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 335.332131] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.642Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4a1f64fa02ec8ed27cef5725","created_at":"2026-09-04T07:46:05.234Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"178eb61b589956bb75493487064d0d2b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.239Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4a1f64fa02ec8ed27cef5725: done: 0.015319 sec","job_status":"done","queue_duration_s":1.387932,"scheduling_latency_s":1.387958,"redis_calls":7,"redis_duration_s":0.001092,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000317,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015319,"completed_at":"2026-09-04T07:46:06.642Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.373187] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.643Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"05806fedcaa97bea13ddd38a","created_at":"2026-09-04T07:46:05.268Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2c4c1760d85763f3d62c97ae57a8018","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.296Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-05806fedcaa97bea13ddd38a: start","job_status":"start","queue_duration_s":1.347819,"scheduling_latency_s":1.347844} gitlab # [ 335.386625] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.667Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"05806fedcaa97bea13ddd38a","created_at":"2026-09-04T07:46:05.268Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2c4c1760d85763f3d62c97ae57a8018","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.296Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-05806fedcaa97bea13ddd38a: done: 0.023548 sec","job_status":"done","queue_duration_s":1.347819,"scheduling_latency_s":1.347844,"redis_calls":12,"redis_duration_s":0.00203,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000468,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000344,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00036,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028614,"duration_s":0.023548,"completed_at":"2026-09-04T07:46:06.667Z","load_balancing_strategy":"primary","db_duration_s":0.000577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.429087] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.668Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"5e6f16b59e08db1dc9a409ec","created_at":"2026-09-04T07:46:05.415Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35a37cf34c30f8bf2cfbb0b2476695d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.429Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-5e6f16b59e08db1dc9a409ec: start","job_status":"start","queue_duration_s":1.239384,"scheduling_latency_s":1.239414} gitlab # [ 335.443892] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.678Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 335.448782] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"5e6f16b59e08db1dc9a409ec","created_at":"2026-09-04T07:46:05.415Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35a37cf34c30f8bf2cfbb0b2476695d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.429Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-5e6f16b59e08db1dc9a409ec: done: 0.015541 sec","job_status":"done","queue_duration_s":1.239384,"scheduling_latency_s":1.239414,"redis_calls":7,"redis_duration_s":0.002219,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001886,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000333,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015541,"completed_at":"2026-09-04T07:46:06.684Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.490555] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.686Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"93efd147c19fbae50a07c52d","created_at":"2026-09-04T07:46:05.443Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2390869b9e0969d27e40ea7ade6617a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.466Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-93efd147c19fbae50a07c52d: start","job_status":"start","queue_duration_s":1.219225,"scheduling_latency_s":1.219256} gitlab # [ 335.504529] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.727Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"93efd147c19fbae50a07c52d","created_at":"2026-09-04T07:46:05.443Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2390869b9e0969d27e40ea7ade6617a9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.466Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-93efd147c19fbae50a07c52d: done: 0.041017 sec","job_status":"done","queue_duration_s":1.219225,"scheduling_latency_s":1.219256,"redis_calls":12,"redis_duration_s":0.002256,"redis_read_bytes":11,"redis_write_bytes":1481,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000383,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001001,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000872,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":548,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024123,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00053552,"exclusive_lock_hold_duration_s":0.01678686,"extra.ci_pipeline_artifacts_expire_artifacts_worker.destroyed_pipeline_artifacts_count":0,"duration_s":0.041017,"completed_at":"2026-09-04T07:46:06.726Z","load_balancing_strategy":"primary","db_duration_s":0.008016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.547567] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:06.728Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"680daf23ece7671d952b67dd","created_at":"2026-09-04T07:46:05.539Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca785ffcb8f4cb071fc5f3a6aa5537b7","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.550Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-680daf23ece7671d952b67dd: start","job_status":"start","queue_duration_s":1.177968,"scheduling_latency_s":1.177997} gitlab # [ 335.561947] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.086Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"680daf23ece7671d952b67dd","created_at":"2026-09-04T07:46:05.539Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-6da87c5c9cef47d3","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca785ffcb8f4cb071fc5f3a6aa5537b7","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.550Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-680daf23ece7671d952b67dd: done: 0.357963 sec","job_status":"done","queue_duration_s":1.177968,"scheduling_latency_s":1.177997,"redis_calls":562,"redis_duration_s":0.067479,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.066499,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.357963,"completed_at":"2026-09-04T07:46:07.086Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.602880] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b7eba2c432f19c856be2c87","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b7eba2c432f19c856be2c87: start","job_status":"start","queue_duration_s":1.240359,"scheduling_latency_s":1.24039} gitlab # [ 335.615560] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b7eba2c432f19c856be2c87","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b7eba2c432f19c856be2c87: done: 0.022623 sec","job_status":"done","queue_duration_s":1.240359,"scheduling_latency_s":1.24039,"redis_calls":13,"redis_duration_s":0.002365,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001532,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022623,"completed_at":"2026-09-04T07:46:07.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.657633] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d90ccc5bfe2b72d4bbb35280","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d90ccc5bfe2b72d4bbb35280: start","job_status":"start","queue_duration_s":1.264746,"scheduling_latency_s":1.264778} gitlab # [ 335.670539] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d90ccc5bfe2b72d4bbb35280","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d90ccc5bfe2b72d4bbb35280: done: 0.023187 sec","job_status":"done","queue_duration_s":1.264746,"scheduling_latency_s":1.264778,"redis_calls":13,"redis_duration_s":0.0030340000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001226,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023187,"completed_at":"2026-09-04T07:46:07.135Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.710453] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6107d3607489cd8e9bd223a4","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6107d3607489cd8e9bd223a4: start","job_status":"start","queue_duration_s":1.289792,"scheduling_latency_s":1.289827} gitlab # [ 335.723119] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6107d3607489cd8e9bd223a4","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6107d3607489cd8e9bd223a4: done: 0.021431 sec","job_status":"done","queue_duration_s":1.289792,"scheduling_latency_s":1.289827,"redis_calls":13,"redis_duration_s":0.002233,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000821,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001412,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021431,"completed_at":"2026-09-04T07:46:07.159Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.763019] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b6c5e2e3a6fdf74bc214fdc","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b6c5e2e3a6fdf74bc214fdc: start","job_status":"start","queue_duration_s":1.313069,"scheduling_latency_s":1.313092} gitlab # [ 335.775729] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b6c5e2e3a6fdf74bc214fdc","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b6c5e2e3a6fdf74bc214fdc: done: 0.015554 sec","job_status":"done","queue_duration_s":1.313069,"scheduling_latency_s":1.313092,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015554,"completed_at":"2026-09-04T07:46:07.176Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.815247] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"520350dc65c429bbece6b353","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-520350dc65c429bbece6b353: start","job_status":"start","queue_duration_s":1.329875,"scheduling_latency_s":1.329892} gitlab # [ 335.828146] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"520350dc65c429bbece6b353","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-520350dc65c429bbece6b353: done: 0.015526 sec","job_status":"done","queue_duration_s":1.329875,"scheduling_latency_s":1.329892,"redis_calls":13,"redis_duration_s":0.0016289999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015526,"completed_at":"2026-09-04T07:46:07.193Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.869889] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cf31fb4bd5bb47f7a216466","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cf31fb4bd5bb47f7a216466: start","job_status":"start","queue_duration_s":1.346629,"scheduling_latency_s":1.346645} gitlab # [ 335.882606] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cf31fb4bd5bb47f7a216466","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cf31fb4bd5bb47f7a216466: done: 0.015424 sec","job_status":"done","queue_duration_s":1.346629,"scheduling_latency_s":1.346645,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015424,"completed_at":"2026-09-04T07:46:07.210Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.922374] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1648d17e0aed47767cf50e69","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1648d17e0aed47767cf50e69: start","job_status":"start","queue_duration_s":1.363269,"scheduling_latency_s":1.363286} gitlab # [ 335.934965] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1648d17e0aed47767cf50e69","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1648d17e0aed47767cf50e69: done: 0.015459 sec","job_status":"done","queue_duration_s":1.363269,"scheduling_latency_s":1.363286,"redis_calls":13,"redis_duration_s":0.001578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015459,"completed_at":"2026-09-04T07:46:07.226Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 335.974460] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0208ac3a454b41c68e667494","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0208ac3a454b41c68e667494: start","job_status":"start","queue_duration_s":1.380734,"scheduling_latency_s":1.380751} gitlab # [ 335.987030] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0208ac3a454b41c68e667494","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0208ac3a454b41c68e667494: done: 0.016283 sec","job_status":"done","queue_duration_s":1.380734,"scheduling_latency_s":1.380751,"redis_calls":13,"redis_duration_s":0.001686,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016283,"completed_at":"2026-09-04T07:46:07.244Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.026804] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bbb74343ca3344a7c95e48b","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bbb74343ca3344a7c95e48b: start","job_status":"start","queue_duration_s":1.398331,"scheduling_latency_s":1.39835} gitlab # [ 336.039469] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bbb74343ca3344a7c95e48b","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bbb74343ca3344a7c95e48b: done: 0.015935 sec","job_status":"done","queue_duration_s":1.398331,"scheduling_latency_s":1.39835,"redis_calls":13,"redis_duration_s":0.0016940000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015935,"completed_at":"2026-09-04T07:46:07.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.080969] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5ad4df4e5ba7b97f0890e18","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5ad4df4e5ba7b97f0890e18: start","job_status":"start","queue_duration_s":1.41554,"scheduling_latency_s":1.415558} gitlab # [ 336.093545] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5ad4df4e5ba7b97f0890e18","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5ad4df4e5ba7b97f0890e18: done: 0.016021 sec","job_status":"done","queue_duration_s":1.41554,"scheduling_latency_s":1.415558,"redis_calls":13,"redis_duration_s":0.0016749999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001075,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016021,"completed_at":"2026-09-04T07:46:07.279Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.133371] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63a188c5e4fb817dc92fb657","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63a188c5e4fb817dc92fb657: start","job_status":"start","queue_duration_s":1.433403,"scheduling_latency_s":1.433423} gitlab # [ 336.146225] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63a188c5e4fb817dc92fb657","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63a188c5e4fb817dc92fb657: done: 0.016315 sec","job_status":"done","queue_duration_s":1.433403,"scheduling_latency_s":1.433423,"redis_calls":13,"redis_duration_s":0.001727,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016315,"completed_at":"2026-09-04T07:46:07.297Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.185567] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"632d03f8eb54a85b4e82099b","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-632d03f8eb54a85b4e82099b: start","job_status":"start","queue_duration_s":1.451003,"scheduling_latency_s":1.451022} gitlab # [ 336.197686] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"632d03f8eb54a85b4e82099b","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-632d03f8eb54a85b4e82099b: done: 0.016281 sec","job_status":"done","queue_duration_s":1.451003,"scheduling_latency_s":1.451022,"redis_calls":13,"redis_duration_s":0.001846,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016281,"completed_at":"2026-09-04T07:46:07.315Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.236614] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9bfe85654592eb557119a34","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9bfe85654592eb557119a34: start","job_status":"start","queue_duration_s":1.468562,"scheduling_latency_s":1.468582} gitlab # [ 336.248881] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9bfe85654592eb557119a34","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9bfe85654592eb557119a34: done: 0.017377 sec","job_status":"done","queue_duration_s":1.468562,"scheduling_latency_s":1.468582,"redis_calls":13,"redis_duration_s":0.002113,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001446,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017377,"completed_at":"2026-09-04T07:46:07.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.289194] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5bc90c53b1807ee15e419cf","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5bc90c53b1807ee15e419cf: start","job_status":"start","queue_duration_s":1.487282,"scheduling_latency_s":1.487302} gitlab # [ 336.301608] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5bc90c53b1807ee15e419cf","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5bc90c53b1807ee15e419cf: done: 0.016878 sec","job_status":"done","queue_duration_s":1.487282,"scheduling_latency_s":1.487302,"redis_calls":13,"redis_duration_s":0.0019039999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016878,"completed_at":"2026-09-04T07:46:07.352Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.340788] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff28482b1fc103989ed30cfe","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff28482b1fc103989ed30cfe: start","job_status":"start","queue_duration_s":1.505572,"scheduling_latency_s":1.505593} gitlab # [ 336.353153] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff28482b1fc103989ed30cfe","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff28482b1fc103989ed30cfe: done: 0.015288 sec","job_status":"done","queue_duration_s":1.505572,"scheduling_latency_s":1.505593,"redis_calls":13,"redis_duration_s":0.001566,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015288,"completed_at":"2026-09-04T07:46:07.368Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.392295] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38cb0d14c28e4992ef02dee8","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38cb0d14c28e4992ef02dee8: start","job_status":"start","queue_duration_s":1.522027,"scheduling_latency_s":1.522045} gitlab # [ 336.404791] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38cb0d14c28e4992ef02dee8","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38cb0d14c28e4992ef02dee8: done: 0.014345 sec","job_status":"done","queue_duration_s":1.522027,"scheduling_latency_s":1.522045,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014345,"completed_at":"2026-09-04T07:46:07.384Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.444274] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"163373847795d4c118e919dc","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-163373847795d4c118e919dc: start","job_status":"start","queue_duration_s":1.537541,"scheduling_latency_s":1.537559} gitlab # [ 336.456418] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"163373847795d4c118e919dc","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-163373847795d4c118e919dc: done: 0.014553 sec","job_status":"done","queue_duration_s":1.537541,"scheduling_latency_s":1.537559,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014553,"completed_at":"2026-09-04T07:46:07.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.496887] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbf3e64b1a5ab041ce72f22f","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbf3e64b1a5ab041ce72f22f: start","job_status":"start","queue_duration_s":1.553272,"scheduling_latency_s":1.55329} gitlab # [ 336.509282] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbf3e64b1a5ab041ce72f22f","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbf3e64b1a5ab041ce72f22f: done: 0.014372 sec","job_status":"done","queue_duration_s":1.553272,"scheduling_latency_s":1.55329,"redis_calls":13,"redis_duration_s":0.00165,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014372,"completed_at":"2026-09-04T07:46:07.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.548489] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ddc9bdd0313ff43a44823ee","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ddc9bdd0313ff43a44823ee: start","job_status":"start","queue_duration_s":1.568817,"scheduling_latency_s":1.568834} gitlab # [ 336.560450] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ddc9bdd0313ff43a44823ee","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ddc9bdd0313ff43a44823ee: done: 0.015355 sec","job_status":"done","queue_duration_s":1.568817,"scheduling_latency_s":1.568834,"redis_calls":13,"redis_duration_s":0.0018629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001285,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015355,"completed_at":"2026-09-04T07:46:07.432Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.600384] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdaaf4b8a22b539a0ee513cd","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdaaf4b8a22b539a0ee513cd: start","job_status":"start","queue_duration_s":1.585458,"scheduling_latency_s":1.585477} gitlab # [ 336.612702] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdaaf4b8a22b539a0ee513cd","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdaaf4b8a22b539a0ee513cd: done: 0.015028 sec","job_status":"done","queue_duration_s":1.585458,"scheduling_latency_s":1.585477,"redis_calls":13,"redis_duration_s":0.0016160000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015028,"completed_at":"2026-09-04T07:46:07.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.651107] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"769c9984604f6bd5c849ca85","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-769c9984604f6bd5c849ca85: start","job_status":"start","queue_duration_s":1.601957,"scheduling_latency_s":1.601976} gitlab # [ 336.663324] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"769c9984604f6bd5c849ca85","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-769c9984604f6bd5c849ca85: done: 0.015233 sec","job_status":"done","queue_duration_s":1.601957,"scheduling_latency_s":1.601976,"redis_calls":13,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015233,"completed_at":"2026-09-04T07:46:07.465Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.703344] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.466Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d46613aacbc187957e722df","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d46613aacbc187957e722df: start","job_status":"start","queue_duration_s":1.61843,"scheduling_latency_s":1.618449} gitlab # [ 336.715695] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d46613aacbc187957e722df","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d46613aacbc187957e722df: done: 0.015302 sec","job_status":"done","queue_duration_s":1.61843,"scheduling_latency_s":1.618449,"redis_calls":13,"redis_duration_s":0.001699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015302,"completed_at":"2026-09-04T07:46:07.481Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.754224] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01fd9c204ed4058bf39e9c5f","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01fd9c204ed4058bf39e9c5f: start","job_status":"start","queue_duration_s":1.634979,"scheduling_latency_s":1.634998} gitlab # [ 336.766437] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01fd9c204ed4058bf39e9c5f","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01fd9c204ed4058bf39e9c5f: done: 0.01582 sec","job_status":"done","queue_duration_s":1.634979,"scheduling_latency_s":1.634998,"redis_calls":13,"redis_duration_s":0.0016719999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01582,"completed_at":"2026-09-04T07:46:07.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.804672] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d07b3776b87fe00efe16b46a","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d07b3776b87fe00efe16b46a: start","job_status":"start","queue_duration_s":1.652066,"scheduling_latency_s":1.652087} gitlab # [ 336.816523] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d07b3776b87fe00efe16b46a","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d07b3776b87fe00efe16b46a: done: 0.031021 sec","job_status":"done","queue_duration_s":1.652066,"scheduling_latency_s":1.652087,"redis_calls":13,"redis_duration_s":0.004221,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001224,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031021,"completed_at":"2026-09-04T07:46:07.531Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.854778] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fb20ad00ea311157e248b0a","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fb20ad00ea311157e248b0a: start","job_status":"start","queue_duration_s":1.684874,"scheduling_latency_s":1.684897} gitlab # [ 336.867101] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fb20ad00ea311157e248b0a","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fb20ad00ea311157e248b0a: done: 0.017716 sec","job_status":"done","queue_duration_s":1.684874,"scheduling_latency_s":1.684897,"redis_calls":13,"redis_duration_s":0.003179,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001035,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002144,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017716,"completed_at":"2026-09-04T07:46:07.550Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 336.907643] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18be2e8110cfa41e4ca021d0","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18be2e8110cfa41e4ca021d0: start","job_status":"start","queue_duration_s":1.704547,"scheduling_latency_s":1.704565} gitlab # [ 336.944888] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18be2e8110cfa41e4ca021d0","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18be2e8110cfa41e4ca021d0: done: 0.01695 sec","job_status":"done","queue_duration_s":1.704547,"scheduling_latency_s":1.704565,"redis_calls":13,"redis_duration_s":0.002913,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001027,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01695,"completed_at":"2026-09-04T07:46:07.569Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.009695] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd0ab274a36ee04b324e8f08","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd0ab274a36ee04b324e8f08: start","job_status":"start","queue_duration_s":1.722933,"scheduling_latency_s":1.722948} gitlab # [ 337.022832] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd0ab274a36ee04b324e8f08","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd0ab274a36ee04b324e8f08: done: 0.016137 sec","job_status":"done","queue_duration_s":1.722933,"scheduling_latency_s":1.722948,"redis_calls":13,"redis_duration_s":0.002752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001765,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016137,"completed_at":"2026-09-04T07:46:07.587Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.064300] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6e370dfad450b124d98aaaa","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6e370dfad450b124d98aaaa: start","job_status":"start","queue_duration_s":1.740514,"scheduling_latency_s":1.740529} gitlab # [ 337.077752] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6e370dfad450b124d98aaaa","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6e370dfad450b124d98aaaa: done: 0.014967 sec","job_status":"done","queue_duration_s":1.740514,"scheduling_latency_s":1.740529,"redis_calls":13,"redis_duration_s":0.002771,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001815,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014967,"completed_at":"2026-09-04T07:46:07.603Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.116578] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b151301f61be04ea5edeb8cd","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b151301f61be04ea5edeb8cd: start","job_status":"start","queue_duration_s":1.757273,"scheduling_latency_s":1.757294} gitlab # [ 337.129097] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b151301f61be04ea5edeb8cd","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b151301f61be04ea5edeb8cd: done: 0.016077 sec","job_status":"done","queue_duration_s":1.757273,"scheduling_latency_s":1.757294,"redis_calls":13,"redis_duration_s":0.0027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001793,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016077,"completed_at":"2026-09-04T07:46:07.620Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.168579] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39a783c4fed5c37845a6cf4d","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39a783c4fed5c37845a6cf4d: start","job_status":"start","queue_duration_s":1.774365,"scheduling_latency_s":1.774381} gitlab # [ 337.180913] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39a783c4fed5c37845a6cf4d","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39a783c4fed5c37845a6cf4d: done: 0.016797 sec","job_status":"done","queue_duration_s":1.774365,"scheduling_latency_s":1.774381,"redis_calls":13,"redis_duration_s":0.00343,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002451,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016797,"completed_at":"2026-09-04T07:46:07.639Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.219862] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6de2a38d6eb771d7b36faf21","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6de2a38d6eb771d7b36faf21: start","job_status":"start","queue_duration_s":1.792638,"scheduling_latency_s":1.792656} gitlab # [ 337.232357] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6de2a38d6eb771d7b36faf21","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6de2a38d6eb771d7b36faf21: done: 0.016202 sec","job_status":"done","queue_duration_s":1.792638,"scheduling_latency_s":1.792656,"redis_calls":13,"redis_duration_s":0.002861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016202,"completed_at":"2026-09-04T07:46:07.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.271231] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bf25f3fe5e6d26bd7fc9d94","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bf25f3fe5e6d26bd7fc9d94: start","job_status":"start","queue_duration_s":1.810299,"scheduling_latency_s":1.810316} gitlab # [ 337.285016] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bf25f3fe5e6d26bd7fc9d94","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bf25f3fe5e6d26bd7fc9d94: done: 0.016996 sec","job_status":"done","queue_duration_s":1.810299,"scheduling_latency_s":1.810316,"redis_calls":13,"redis_duration_s":0.002064,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001256,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016996,"completed_at":"2026-09-04T07:46:07.675Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.323870] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3cbdfa0c50cf6dcb1cdcded","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3cbdfa0c50cf6dcb1cdcded: start","job_status":"start","queue_duration_s":1.828775,"scheduling_latency_s":1.828796} gitlab # [ 337.336319] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3cbdfa0c50cf6dcb1cdcded","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3cbdfa0c50cf6dcb1cdcded: done: 0.017474 sec","job_status":"done","queue_duration_s":1.828775,"scheduling_latency_s":1.828796,"redis_calls":13,"redis_duration_s":0.0022890000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001494,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017474,"completed_at":"2026-09-04T07:46:07.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.375244] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"917ab0d07298b7485dad13d9","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-917ab0d07298b7485dad13d9: start","job_status":"start","queue_duration_s":1.847721,"scheduling_latency_s":1.847742} gitlab # [ 337.387693] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"917ab0d07298b7485dad13d9","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-917ab0d07298b7485dad13d9: done: 0.016559 sec","job_status":"done","queue_duration_s":1.847721,"scheduling_latency_s":1.847742,"redis_calls":13,"redis_duration_s":0.002043,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001324,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016559,"completed_at":"2026-09-04T07:46:07.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.426590] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f42d5a8fff646f52a4e58470","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f42d5a8fff646f52a4e58470: start","job_status":"start","queue_duration_s":1.86573,"scheduling_latency_s":1.865752} gitlab # [ 337.438943] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f42d5a8fff646f52a4e58470","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f42d5a8fff646f52a4e58470: done: 0.016095 sec","job_status":"done","queue_duration_s":1.86573,"scheduling_latency_s":1.865752,"redis_calls":13,"redis_duration_s":0.0019039999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016095,"completed_at":"2026-09-04T07:46:07.729Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.477993] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e76defb488ecf695ccde34b","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e76defb488ecf695ccde34b: start","job_status":"start","queue_duration_s":1.884103,"scheduling_latency_s":1.884124} gitlab # [ 337.491659] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e76defb488ecf695ccde34b","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e76defb488ecf695ccde34b: done: 0.015677 sec","job_status":"done","queue_duration_s":1.884103,"scheduling_latency_s":1.884124,"redis_calls":13,"redis_duration_s":0.001747,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015677,"completed_at":"2026-09-04T07:46:07.747Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.530266] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"159f0b9513e8852484612e20","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-159f0b9513e8852484612e20: start","job_status":"start","queue_duration_s":1.900974,"scheduling_latency_s":1.900992} gitlab # [ 337.542575] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"159f0b9513e8852484612e20","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-159f0b9513e8852484612e20: done: 0.014794 sec","job_status":"done","queue_duration_s":1.900974,"scheduling_latency_s":1.900992,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014794,"completed_at":"2026-09-04T07:46:07.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.581776] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7520b82693366d44161318bb","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7520b82693366d44161318bb: start","job_status":"start","queue_duration_s":1.916992,"scheduling_latency_s":1.91701} gitlab # [ 337.594059] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7520b82693366d44161318bb","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7520b82693366d44161318bb: done: 0.014838 sec","job_status":"done","queue_duration_s":1.916992,"scheduling_latency_s":1.91701,"redis_calls":13,"redis_duration_s":0.0015409999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014838,"completed_at":"2026-09-04T07:46:07.779Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.632588] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"145276519770f50b43508623","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-145276519770f50b43508623: start","job_status":"start","queue_duration_s":1.933003,"scheduling_latency_s":1.933032} gitlab # [ 337.644801] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"145276519770f50b43508623","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-145276519770f50b43508623: done: 0.015744 sec","job_status":"done","queue_duration_s":1.933003,"scheduling_latency_s":1.933032,"redis_calls":13,"redis_duration_s":0.001518,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015744,"completed_at":"2026-09-04T07:46:07.796Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.683760] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63017200361455b716a51448","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63017200361455b716a51448: start","job_status":"start","queue_duration_s":1.949983,"scheduling_latency_s":1.949999} gitlab # [ 337.697406] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63017200361455b716a51448","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63017200361455b716a51448: done: 0.016044 sec","job_status":"done","queue_duration_s":1.949983,"scheduling_latency_s":1.949999,"redis_calls":13,"redis_duration_s":0.001679,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016044,"completed_at":"2026-09-04T07:46:07.813Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.736277] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66cc2c81b9c95467a9c67381","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66cc2c81b9c95467a9c67381: start","job_status":"start","queue_duration_s":1.967318,"scheduling_latency_s":1.967337} gitlab # [ 337.748331] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66cc2c81b9c95467a9c67381","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66cc2c81b9c95467a9c67381: done: 0.016429 sec","job_status":"done","queue_duration_s":1.967318,"scheduling_latency_s":1.967337,"redis_calls":13,"redis_duration_s":0.001779,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001132,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016429,"completed_at":"2026-09-04T07:46:07.831Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.786821] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fadd32d869bd26ec84c90154","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fadd32d869bd26ec84c90154: start","job_status":"start","queue_duration_s":1.985553,"scheduling_latency_s":1.985573} gitlab # [ 337.799282] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fadd32d869bd26ec84c90154","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fadd32d869bd26ec84c90154: done: 0.016844 sec","job_status":"done","queue_duration_s":1.985553,"scheduling_latency_s":1.985573,"redis_calls":13,"redis_duration_s":0.001871,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016844,"completed_at":"2026-09-04T07:46:07.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.838537] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f0222a5215bd6c05d4c386c","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f0222a5215bd6c05d4c386c: start","job_status":"start","queue_duration_s":2.003746,"scheduling_latency_s":2.003764} gitlab # [ 337.850646] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f0222a5215bd6c05d4c386c","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f0222a5215bd6c05d4c386c: done: 0.017622 sec","job_status":"done","queue_duration_s":2.003746,"scheduling_latency_s":2.003764,"redis_calls":13,"redis_duration_s":0.001825,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001175,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017622,"completed_at":"2026-09-04T07:46:07.869Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.889099] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d49778ae06469e8c0b4c42e","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d49778ae06469e8c0b4c42e: start","job_status":"start","queue_duration_s":2.022707,"scheduling_latency_s":2.022725} gitlab # [ 337.902683] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d49778ae06469e8c0b4c42e","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d49778ae06469e8c0b4c42e: done: 0.016824 sec","job_status":"done","queue_duration_s":2.022707,"scheduling_latency_s":2.022725,"redis_calls":13,"redis_duration_s":0.001859,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016824,"completed_at":"2026-09-04T07:46:07.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.941319] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20526d68abf29d04d33b7c87","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20526d68abf29d04d33b7c87: start","job_status":"start","queue_duration_s":2.040959,"scheduling_latency_s":2.040976} gitlab # [ 337.953649] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20526d68abf29d04d33b7c87","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20526d68abf29d04d33b7c87: done: 0.017076 sec","job_status":"done","queue_duration_s":2.040959,"scheduling_latency_s":2.040976,"redis_calls":13,"redis_duration_s":0.00185,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001165,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017076,"completed_at":"2026-09-04T07:46:07.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 337.992020] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9aa51b0f17b5b9e02f53161a","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9aa51b0f17b5b9e02f53161a: start","job_status":"start","queue_duration_s":2.059393,"scheduling_latency_s":2.059411} gitlab # [ 338.004063] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9aa51b0f17b5b9e02f53161a","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9aa51b0f17b5b9e02f53161a: done: 0.016609 sec","job_status":"done","queue_duration_s":2.059393,"scheduling_latency_s":2.059411,"redis_calls":13,"redis_duration_s":0.001894,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001211,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016609,"completed_at":"2026-09-04T07:46:07.923Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 338.042316] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6079405f1213a29a8979814","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6079405f1213a29a8979814: start","job_status":"start","queue_duration_s":2.077734,"scheduling_latency_s":2.077751} gitlab # [ 338.054796] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6079405f1213a29a8979814","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6079405f1213a29a8979814: done: 0.01527 sec","job_status":"done","queue_duration_s":2.077734,"scheduling_latency_s":2.077751,"redis_calls":13,"redis_duration_s":0.0015149999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01527,"completed_at":"2026-09-04T07:46:07.940Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 338.094271] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca2826a45f33e42277048bec","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca2826a45f33e42277048bec: start","job_status":"start","queue_duration_s":2.094142,"scheduling_latency_s":2.094158} gitlab # [ 338.108046] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca2826a45f33e42277048bec","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca2826a45f33e42277048bec: done: 0.014837 sec","job_status":"done","queue_duration_s":2.094142,"scheduling_latency_s":2.094158,"redis_calls":13,"redis_duration_s":0.002029,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014837,"completed_at":"2026-09-04T07:46:07.956Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 338.146445] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d2e72eaba8efc929da3bd69","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d2e72eaba8efc929da3bd69: start","job_status":"start","queue_duration_s":2.110123,"scheduling_latency_s":2.110139} gitlab # [ 338.158785] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d2e72eaba8efc929da3bd69","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d2e72eaba8efc929da3bd69: done: 0.015489 sec","job_status":"done","queue_duration_s":2.110123,"scheduling_latency_s":2.110139,"redis_calls":13,"redis_duration_s":0.001611,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015489,"completed_at":"2026-09-04T07:46:07.973Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 338.197009] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8498a2ac8aaeeec9304d6e9b","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8498a2ac8aaeeec9304d6e9b: start","job_status":"start","queue_duration_s":2.126807,"scheduling_latency_s":2.126824} gitlab # [ 338.209330] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8498a2ac8aaeeec9304d6e9b","created_at":"2026-09-04T07:46:05.749Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-ebab51bfd8714c24","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9e5f0764c016241443ca2b1f81976c19","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:05.848Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8498a2ac8aaeeec9304d6e9b: done: 0.015526 sec","job_status":"done","queue_duration_s":2.126807,"scheduling_latency_s":2.126824,"redis_calls":13,"redis_duration_s":0.001692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015526,"completed_at":"2026-09-04T07:46:07.990Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 338.248089] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:07.991Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5c6c6cd0c6d6885133f87305","created_at":"2026-09-04T07:46:06.470Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-030b5504b7994d01","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"52e09b95e4505e1dce92a7eda2a7f5a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:06.494Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5c6c6cd0c6d6885133f87305: start","job_status":"start","queue_duration_s":1.497277,"scheduling_latency_s":1.497296} gitlab # [ 338.260149] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:08.004Z","message":"No existing merge request to be cleaned up."} gitlab # [ 338.261800] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:08.015Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5c6c6cd0c6d6885133f87305","created_at":"2026-09-04T07:46:06.470Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-030b5504b7994d01","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"52e09b95e4505e1dce92a7eda2a7f5a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:06.494Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5c6c6cd0c6d6885133f87305: done: 0.023509 sec","job_status":"done","queue_duration_s":1.497277,"scheduling_latency_s":1.497296,"redis_calls":10,"redis_duration_s":0.001642,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023509,"completed_at":"2026-09-04T07:46:08.015Z","load_balancing_strategy":"primary","db_duration_s":0.002348,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 338.304699] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:08.016Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c01bc7ff59a4c7239f3b03ca","created_at":"2026-09-04T07:46:06.470Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-030b5504b7994d01","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"52e09b95e4505e1dce92a7eda2a7f5a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:06.494Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c01bc7ff59a4c7239f3b03ca: start","job_status":"start","queue_duration_s":1.522125,"scheduling_latency_s":1.522145} gitlab # [ 338.317185] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:08.028Z","message":"No existing merge request to be cleaned up."} gitlab # [ 338.318885] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:08.038Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c01bc7ff59a4c7239f3b03ca","created_at":"2026-09-04T07:46:06.470Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-030b5504b7994d01","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"52e09b95e4505e1dce92a7eda2a7f5a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:06.494Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c01bc7ff59a4c7239f3b03ca: done: 0.021855 sec","job_status":"done","queue_duration_s":1.522125,"scheduling_latency_s":1.522145,"redis_calls":10,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000664,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021855,"completed_at":"2026-09-04T07:46:08.038Z","load_balancing_strategy":"primary","db_duration_s":0.00191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 338.357732] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:08.039Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"47dac5b0b95c294d5c2d91b4","created_at":"2026-09-04T07:46:06.470Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-030b5504b7994d01","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"52e09b95e4505e1dce92a7eda2a7f5a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:06.494Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-47dac5b0b95c294d5c2d91b4: start","job_status":"start","queue_duration_s":1.545249,"scheduling_latency_s":1.54527} gitlab # [ 338.369706] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:08.051Z","message":"No existing merge request to be cleaned up."} gitlab # [ 338.371377] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:08.062Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"47dac5b0b95c294d5c2d91b4","created_at":"2026-09-04T07:46:06.470Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-030b5504b7994d01","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"52e09b95e4505e1dce92a7eda2a7f5a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:06.494Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-47dac5b0b95c294d5c2d91b4: done: 0.022404 sec","job_status":"done","queue_duration_s":1.545249,"scheduling_latency_s":1.54527,"redis_calls":10,"redis_duration_s":0.0016220000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022404,"completed_at":"2026-09-04T07:46:08.061Z","load_balancing_strategy":"primary","db_duration_s":0.001857,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 338.410150] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:08.063Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"084341d620ca106a12d59d92","created_at":"2026-09-04T07:46:06.470Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-030b5504b7994d01","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"52e09b95e4505e1dce92a7eda2a7f5a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:06.494Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-084341d620ca106a12d59d92: start","job_status":"start","queue_duration_s":1.568968,"scheduling_latency_s":1.568988} gitlab # [ 338.422564] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:08.076Z","message":"No existing merge request to be cleaned up."} gitlab # [ 338.424324] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:08.085Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"084341d620ca106a12d59d92","created_at":"2026-09-04T07:46:06.470Z","trace_propagation_headers":{"sentry-trace":"c4aceddadbb1455d8dcc771ef72a8475-030b5504b7994d01","baggage":"sentry-trace_id=c4aceddadbb1455d8dcc771ef72a8475,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"52e09b95e4505e1dce92a7eda2a7f5a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:46:06.494Z","job_size_bytes":2,"pid":2193,"sidekiq_tid":"m7sp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-084341d620ca106a12d59d92: done: 0.022474 sec","job_status":"done","queue_duration_s":1.568968,"scheduling_latency_s":1.568988,"redis_calls":10,"redis_duration_s":0.001752,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022474,"completed_at":"2026-09-04T07:46:08.085Z","load_balancing_strategy":"primary","db_duration_s":0.001903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 372.842012] postgres[3692]: [3692] ERROR: relation "table_without_models" does not exist gitlab # [ 372.842641] postgres[3692]: [3692] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 378.807813] runuser[3312]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 378.809782] setup-gitlab-start[3277]: + systemctl restart gitlab-sidekiq.service gitlab # [ 378.852732] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 378.856370] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:50.464Z","message":"Shutting down"} gitlab # [ 378.860658] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:50.465Z","message":"Scheduler exiting..."} gitlab # [ 378.865732] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:50.466Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 378.870917] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:50.466Z","message":"Scheduler exiting..."} gitlab # [ 379.355862] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:50.967Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 382.361153] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:53.972Z","message":"Bye!"} gitlab # [ 382.404876] sidekiq-cluster[2193]: {"severity":"INFO","time":"2026-09-04T07:46:54.016Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2193,"worker_id":"sidekiq_0","memwd_rss_bytes":959057920,"retry":0} gitlab # [ 383.288898] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 383.289597] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 383.294014] systemd[1]: gitlab-sidekiq.service: Consumed 2min 15.404s CPU time over 3min 58.299s wall clock time, 947M memory peak, 4.6M read from disk. gitlab # [ 383.302399] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 383.307836] setup-gitlab-start[3277]: + mkdir -p /var/lib/secrets gitlab # [ 383.312116] setup-gitlab-start[3277]: + echo nixbot-test-token-of-20-chars gitlab # [ 383.315012] setup-gitlab-start[3277]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 383.318871] setup-gitlab-start[3277]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 385.755032] gitaly[899]: time="2026-09-04T07:46:57.365Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:47:07.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:57.364" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 385.755509] gitaly[899]: time="2026-09-04T07:46:57.366Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:47:07.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:57.364" grpc.time_ms=1.141 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.143097] gitaly[899]: time="2026-09-04T07:46:58.754Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:47:08.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:58.753" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.143614] gitaly[899]: time="2026-09-04T07:46:58.754Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:47:08.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:58.753" grpc.time_ms=0.695 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.276557] gitaly[899]: time="2026-09-04T07:46:58.888Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB diskcache=c388b6d7-91bd-47ea-956f-4aa6573b5c88 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:47:08.074" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:58.824" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.308441] gitaly[899]: time="2026-09-04T07:46:58.889Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=33 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1436 command.oublock=32 command.real_time_ms=38 command.spawn_token_fork_ms=5 command.system_time_ms=30 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:47:08.074" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:58.824" grpc.time_ms=64.22 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.340794] gitaly[899]: time="2026-09-04T07:46:58.914Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:47:08.162" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:58.913" pid=899 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 387.361736] gitaly[899]: time="2026-09-04T07:46:58.915Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:47:08.162" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:58.913" grpc.time_ms=1.633 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.379423] gitaly[899]: time="2026-09-04T07:46:58.939Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:47:08.170" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:58.921" grpc.time_ms=17.601 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.441315] gitaly[899]: time="2026-09-04T07:46:59.053Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:47:09.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:59.053" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.459338] gitaly[899]: time="2026-09-04T07:46:59.053Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:47:09.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:59.053" grpc.time_ms=0.615 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.503909] gitaly[899]: time="2026-09-04T07:46:59.116Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB diskcache=3d64d060-9a4d-4909-84d7-b1c8895f0df1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:47:09.006" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:59.056" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.528187] gitaly[899]: time="2026-09-04T07:46:59.116Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=35 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1442 command.oublock=32 command.real_time_ms=39 command.spawn_token_fork_ms=1 command.system_time_ms=19 command.user_time_ms=16 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:47:09.006" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:59.056" grpc.time_ms=59.671 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.550095] gitaly[899]: time="2026-09-04T07:46:59.128Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:47:09.076" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:59.127" pid=899 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 387.564275] gitaly[899]: time="2026-09-04T07:46:59.129Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:47:09.076" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:59.127" grpc.time_ms=1.395 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.577111] gitaly[899]: time="2026-09-04T07:46:59.153Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:47:09.085" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:59.136" grpc.time_ms=16.666 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.618965] gitaly[899]: time="2026-09-04T07:46:59.228Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:47:09.176" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:59.227" grpc.time_ms=0.48 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.639088] gitaly[899]: time="2026-09-04T07:46:59.251Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:47:09.199" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:46:59.250" grpc.time_ms=0.638 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 388.446465] gitaly[899]: time="2026-09-04T07:47:00.058Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP52BFR6RKKBV59VJ63GWB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:47:10.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:00.039" grpc.time_ms=18.326 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 388.912659] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:00 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 5564 gitlab # [ 388.924318] setup-gitlab-start[3277]: + mkdir -p /tmp/test-flake gitlab # [ 388.928911] setup-gitlab-start[3277]: + cd /tmp/test-flake gitlab # [ 388.931484] setup-gitlab-start[3277]: + git init -b master gitlab # [ 388.935249] sidekiq-cluster[3759]: {"severity":"INFO","time":"2026-09-04T07:47:00.494Z","message":"Starting cluster with 1 processes"} gitlab # [ 388.971748] setup-gitlab-start[3824]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 388.975532] setup-gitlab-start[3277]: + git config user.name test gitlab # [ 388.979996] setup-gitlab-start[3277]: + git config user.email test@example.com gitlab # [ 388.986904] setup-gitlab-start[3277]: + cat gitlab # [ 388.990755] setup-gitlab-start[3277]: + git add flake.nix gitlab # [ 388.996933] setup-gitlab-start[3277]: + git commit -m 'initial commit' gitlab # [ 389.032458] setup-gitlab-start[3833]: [master (root-commit) 9727315] initial commit gitlab # [ 389.034934] setup-gitlab-start[3833]: 1 file changed, 10 insertions(+) gitlab # [ 389.037092] setup-gitlab-start[3833]: create mode 100644 flake.nix gitlab # [ 389.039122] setup-gitlab-start[3277]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 389.046423] setup-gitlab-start[3277]: + git push -u origin master gitlab # [ 389.157151] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:00 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 54 gitlab # [ 389.316431] gitaly[899]: time="2026-09-04T07:47:00.928Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP58195610S2CAX4GDV35H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:00.910" grpc.time_ms=17.771 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 389.359425] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:00 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 151 gitlab # [ 390.215522] gitaly[899]: time="2026-09-04T07:47:01.826Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:47:11.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:01.808" grpc.time_ms=18.281 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 390.268886] gitaly[899]: time="2026-09-04T07:47:01.881Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:47:31.068" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:47:01.869" grpc.time_ms=11.587 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 390.340641] gitaly[899]: time="2026-09-04T07:47:01.953Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD duration_ms=365ns method=POST pid=899 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 390.383890] gitaly[899]: time="2026-09-04T07:47:01.996Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD duration_ms=42ns method=POST pid=899 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 390.393788] gitaly[899]: time="2026-09-04T07:47:01.997Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:01.583" grpc.time_ms=413.227 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 390.448864] gitaly[899]: time="2026-09-04T07:47:02.061Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:02.058" grpc.time_ms=2.275 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 390.525007] gitaly[899]: time="2026-09-04T07:47:02.137Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:02.135" grpc.time_ms=1.224 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 390.576999] gitaly[899]: time="2026-09-04T07:47:02.189Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:02.188" grpc.time_ms=1.2 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 390.752761] gitaly[899]: time="2026-09-04T07:47:02.365Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:47:12.293" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:02.344" grpc.time_ms=20.213 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 390.844074] gitaly[899]: time="2026-09-04T07:47:02.456Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=25 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=5 command.system_time_ms=20 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T07:47:12.059" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:02.420" grpc.time_ms=35.119 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 390.923790] gitaly[899]: time="2026-09-04T07:47:02.536Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD duration_ms=302ns method=POST pid=899 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 390.933140] gitaly[899]: time="2026-09-04T07:47:02.537Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:02.231" grpc.time_ms=305.714 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 390.965015] gitaly[899]: time="2026-09-04T07:47:02.557Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD diskcache=94698cd9-544e-4983-8103-8257815a8606 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:01.464" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 390.990119] systemd[1]: Finished setup-gitlab.service. gitlab # [ 390.992644] gitlab-workhorse[826]: time="2026-09-04T07:47:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 390.996217] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:02 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1608 gitlab # [ 391.000145] setup-gitlab-start[3837]: To http://gitlab/root/test-flake.git gitlab # [ 391.001872] setup-gitlab-start[3837]: * [new branch] master -> master gitlab # [ 391.003600] setup-gitlab-start[3837]: branch 'master' set up to track 'origin/master'. gitlab # [ 391.005734] gitaly[899]: time="2026-09-04T07:47:02.558Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=349 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13043 command.oublock=32 command.real_time_ms=1084 command.spawn_token_fork_ms=1 command.system_time_ms=203 command.user_time_ms=146 component=gitaly.StreamServerInterceptor correlation_id=01M1NP586PFGWZEQ6H3RS4T4YD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:01.464" grpc.time_ms=1093.684 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 391.029587] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 392.50 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 392.437322] nixbot[3928]: {"ts": "2026-09-04T07:47:04.048Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 392.480556] nixbot[3928]: {"ts": "2026-09-04T07:47:04.092Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 392.521900] nixbot[3928]: {"ts": "2026-09-04T07:47:04.134Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 392.529358] nixbot[3928]: {"ts": "2026-09-04T07:47:04.141Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 392.536363] nixbot[3928]: {"ts": "2026-09-04T07:47:04.148Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 392.546748] nixbot[3928]: {"ts": "2026-09-04T07:47:04.159Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 392.553826] nixbot[3928]: {"ts": "2026-09-04T07:47:04.166Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 392.560321] nixbot[3928]: {"ts": "2026-09-04T07:47:04.169Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 392.566658] nixbot[3928]: {"ts": "2026-09-04T07:47:04.178Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 392.573212] nixbot[3928]: {"ts": "2026-09-04T07:47:04.182Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 392.580854] nixbot[3928]: {"ts": "2026-09-04T07:47:04.190Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 392.589937] nixbot[3928]: {"ts": "2026-09-04T07:47:04.202Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 392.596534] nixbot[3928]: {"ts": "2026-09-04T07:47:04.208Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 392.603429] nixbot[3928]: {"ts": "2026-09-04T07:47:04.211Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 392.610529] nixbot[3928]: {"ts": "2026-09-04T07:47:04.219Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 392.617311] nixbot[3928]: {"ts": "2026-09-04T07:47:04.222Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 392.624763] nixbot[3928]: {"ts": "2026-09-04T07:47:04.224Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 392.630896] nixbot[3928]: {"ts": "2026-09-04T07:47:04.227Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 392.636611] nixbot[3928]: {"ts": "2026-09-04T07:47:04.235Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 392.643246] nixbot[3928]: {"ts": "2026-09-04T07:47:04.239Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 392.648641] nixbot[3928]: {"ts": "2026-09-04T07:47:04.242Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 392.653563] nixbot[3928]: {"ts": "2026-09-04T07:47:04.252Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 392.658782] nixbot[3928]: {"ts": "2026-09-04T07:47:04.255Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 392.663955] nixbot[3928]: {"ts": "2026-09-04T07:47:04.259Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 392.668416] nixbot[3928]: {"ts": "2026-09-04T07:47:04.261Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 392.672877] nixbot[3928]: {"ts": "2026-09-04T07:47:04.265Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"} gitlab # [ 392.677118] nixbot[3928]: {"ts": "2026-09-04T07:47:04.269Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"} gitlab # [ 392.681479] nixbot[3928]: {"ts": "2026-09-04T07:47:04.272Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"} gitlab # [ 392.685200] nixbot[3928]: {"ts": "2026-09-04T07:47:04.274Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"} gitlab # [ 392.688768] nixbot[3928]: {"ts": "2026-09-04T07:47:04.299Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"} gitlab # [ 392.694848] nixbot[3928]: {"ts": "2026-09-04T07:47:04.307Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"} gitlab # [ 392.698537] nixbot[3928]: {"ts": "2026-09-04T07:47:04.310Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"} gitlab # [ 393.204651] nixbot[3928]: INFO: Started server process [3928] gitlab # [ 393.208158] nixbot[3928]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 393.258292] nixbot[3928]: INFO: ::ffff:127.0.0.1:50560 - "GET /health HTTP/1.1" 200 OK gitlab # [ 393.266016] systemd[1]: Started nixbot CI service. gitlab # [ 393.268818] systemd[1]: Reached target Multi-User System. gitlab # [ 393.271657] systemd[1]: Startup finished in 1.028s (kernel) + 5.381s (initrd) + 6min 26.861s (userspace) = 6min 33.271s. gitlab # [ 393.620873] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:05 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 364 gitlab # [ 393.631633] nixbot[3928]: {"ts": "2026-09-04T07:47:05.235Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 393.661181] nixbot[3928]: {"ts": "2026-09-04T07:47:05.273Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 393.757355] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 84 gitlab # [ 393.772376] nixbot[3928]: {"ts": "2026-09-04T07:47:05.378Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 393.782710] nixbot[3928]: {"ts": "2026-09-04T07:47:05.382Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 394.008213] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:05 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 224 gitlab # [ 394.020930] nixbot[3928]: {"ts": "2026-09-04T07:47:05.629Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab: (finished: waiting for unit nixbot.service, in 2.16 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 394.226710] nixbot[3928]: INFO: ::ffff:127.0.0.1:50572 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 394.383622] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 88 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.16 seconds) (finished: subtest: project discovered and webhook registered, in 0.16 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 394.520349] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:06 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 44 gitlab # [ 394.898764] gitaly[899]: time="2026-09-04T07:47:06.509Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5D8XD23NVDB4TVNJBEF6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:06.495" grpc.time_ms=14.447 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 394.938870] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:06 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 408 gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 91.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 395.362092] gitaly[899]: time="2026-09-04T07:47:06.974Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5DQ1D1N5EM145QSG3NTC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:47:36.052" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:47:06.952" grpc.time_ms=21.558 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 395.422000] gitaly[899]: time="2026-09-04T07:47:07.034Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NP5DQ1D1N5EM145QSG3NTC duration_ms=211ns method=POST pid=899 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 395.491778] gitaly[899]: time="2026-09-04T07:47:07.103Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NP5DQ1D1N5EM145QSG3NTC duration_ms=67ns method=POST pid=899 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 395.505516] gitaly[899]: time="2026-09-04T07:47:07.103Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP5DQ1D1N5EM145QSG3NTC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:06.822" grpc.time_ms=281.663 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 395.540523] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:07 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1482 gitlab # [ 395.547534] nixbot[3928]: {"ts": "2026-09-04T07:47:07.126Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 395.586320] gitaly[899]: time="2026-09-04T07:47:07.198Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP5DQ1D1N5EM145QSG3NTC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:07.197" grpc.time_ms=1.204 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 395.655500] gitaly[899]: time="2026-09-04T07:47:07.267Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP5DQ1D1N5EM145QSG3NTC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:07.266" grpc.time_ms=1.007 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 395.676432] nixbot[3928]: {"ts": "2026-09-04T07:47:07.288Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 395.678722] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 149 gitlab # [ 395.721977] gitaly[899]: time="2026-09-04T07:47:07.333Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP5DQ1D1N5EM145QSG3NTC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:07.329" grpc.time_ms=4.091 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 395.814506] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:07 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 125 gitlab # [ 395.817888] nixbot[3928]: {"ts": "2026-09-04T07:47:07.430Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 395.853750] gitaly[899]: time="2026-09-04T07:47:07.465Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NP5DQ1D1N5EM145QSG3NTC duration_ms=92ns method=POST pid=899 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 395.864278] gitaly[899]: time="2026-09-04T07:47:07.466Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP5DQ1D1N5EM145QSG3NTC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:07.370" grpc.time_ms=95.669 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 395.883756] gitaly[899]: time="2026-09-04T07:47:07.496Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NP5DQ1D1N5EM145QSG3NTC diskcache=58b1b379-4a4a-41c7-8b66-4890af4a7193 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:06.737" pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # To http://gitlab/root/test-flake.git gitlab # 9727315..0b45fc7 master -> master[ 395.900428] gitaly[899]: time="2026-09-04T07:47:07.501Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=270 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13614 command.oublock=32 command.real_time_ms=750 command.spawn_token_fork_ms=4 command.system_time_ms=152 command.user_time_ms=118 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5DQ1D1N5EM145QSG3NTC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:06.737" grpc.time_ms=763.546 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # gitlab # [ 395.918593] gitlab-workhorse[826]: time="2026-09-04T07:47:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 395.921108] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:07 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 908 gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.55 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab # [ 395.923417] gitaly[899]: time="2026-09-04T07:47:07.534Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=12 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5EHGF3S42F8GE7KCFEWJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-04T07:47:37.005" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=255 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:07.506" grpc.time_ms=27.601 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 395.944310] gitaly[899]: time="2026-09-04T07:47:07.556Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5EHGF3S42F8GE7KCFEWJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:37.055" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:07.555" grpc.time_ms=0.865 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 395.960140] gitaly[899]: time="2026-09-04T07:47:07.572Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=6 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5EHGF3S42F8GE7KCFEWJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-04T07:47:17.010" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:07.561" grpc.time_ms=10.93 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0b45fc7c12004a74b031dd4d3710eba5a1254657' gitlab # [ 396.006774] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 772 "" "python-httpx/0.28.1" 177 gitlab # [ 396.051111] nixbot[3928]: {"ts": "2026-09-04T07:47:07.663Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 396.066501] nixbot[3928]: INFO: ::ffff:127.0.0.1:50580 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0b45fc7c12004a74b031dd4d3710eba5a1254657 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0b45fc7c12004a74b031dd4d3710eba5a1254657', in 0.10 seconds) gitlab # [ 396.218092] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 162 gitlab # [ 396.225895] nixbot[3928]: {"ts": "2026-09-04T07:47:07.832Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 396.234136] nixbot[3928]: {"ts": "2026-09-04T07:47:07.840Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 396.431185] gitaly[899]: time="2026-09-04T07:47:08.043Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5F0B5PZAFGQQVEXT3CPY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:08.022" grpc.time_ms=21.128 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 396.465006] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 129 gitlab # [ 396.675526] gitaly[899]: time="2026-09-04T07:47:08.287Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5F4FEKQ9XBNAKDC32STH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:08.265" pid=899 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 396.706836] gitaly[899]: time="2026-09-04T07:47:08.288Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5F4FEKQ9XBNAKDC32STH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:08.265" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 396.744646] gitlab-workhorse[826]: time="2026-09-04T07:47:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 396.748780] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 242 gitlab # [ 396.752630] gitaly[899]: time="2026-09-04T07:47:08.289Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5F4FEKQ9XBNAKDC32STH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:08.265" grpc.time_ms=22.761 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 396.845635] gitaly[899]: time="2026-09-04T07:47:08.457Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5FCBD66QXKVPDEVXY39D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:08.415" pid=899 remote_ip="2001:db8:1::1" request_sha=5519e33bd9c9eb6b28106b7525dd4a53c3d69c8e response_bytes=418 span.kind=server system=grpc gitlab # [ 396.878102] gitaly[899]: time="2026-09-04T07:47:08.458Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=32 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1133 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=3 command.system_time_ms=24 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5FCBD66QXKVPDEVXY39D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:08.415" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 396.914625] gitlab-workhorse[826]: time="2026-09-04T07:47:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=418 gitlab # [ 396.919574] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 418 "" "git/2.55.0" 160 gitlab # [ 396.924256] gitaly[899]: time="2026-09-04T07:47:08.459Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=32 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1133 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=3 command.system_time_ms=24 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5FCBD66QXKVPDEVXY39D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:08.415" grpc.time_ms=43.43 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0b45fc7c12004a74b031dd4d3710eba5a1254657' gitlab # [ 397.100618] gitaly[899]: time="2026-09-04T07:47:08.712Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=4 command.system_time_ms=19 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5FKSSXR19MRVJ4089T53 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:08.681" grpc.time_ms=30.826 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 397.137344] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 176 gitlab # [ 397.155625] nixbot[3928]: INFO: ::ffff:127.0.0.1:50586 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0b45fc7c12004a74b031dd4d3710eba5a1254657 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0b45fc7c12004a74b031dd4d3710eba5a1254657', in 0.09 seconds) gitlab # [ 397.407581] gitaly[899]: time="2026-09-04T07:47:09.019Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5FSEWCYBBGZSPFSE9F0Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:08.988" pid=899 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 397.437393] gitaly[899]: time="2026-09-04T07:47:09.020Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=4 command.system_time_ms=16 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5FSEWCYBBGZSPFSE9F0Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:08.988" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 397.463151] gitlab-workhorse[826]: time="2026-09-04T07:47:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 397.466323] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 304 gitlab # [ 397.469331] gitaly[899]: time="2026-09-04T07:47:09.021Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=4 command.system_time_ms=16 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5FSEWCYBBGZSPFSE9F0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:08.988" grpc.time_ms=32.95 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 397.684371] gitaly[899]: time="2026-09-04T07:47:09.296Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5G6MDTEFNA3JPV6R1DPW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:09.276" grpc.time_ms=19.345 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 397.725192] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 156 gitlab # [ 397.843670] gitaly[899]: time="2026-09-04T07:47:09.455Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5GBMKYM637VZ071154KF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:09.421" pid=899 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 397.876066] gitaly[899]: time="2026-09-04T07:47:09.456Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=17 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5GBMKYM637VZ071154KF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:09.421" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 397.913904] gitlab-workhorse[826]: time="2026-09-04T07:47:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 397.918515] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 157 gitlab # [ 397.922599] gitaly[899]: time="2026-09-04T07:47:09.456Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=17 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5GBMKYM637VZ071154KF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:09.421" grpc.time_ms=34.936 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 398.117076] gitaly[899]: time="2026-09-04T07:47:09.728Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5GMKP91FEHEN4RG5BQ0S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:39.025" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:09.726" grpc.time_ms=1.152 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0b45fc7c12004a74b031dd4d3710eba5a1254657' gitlab # [ 398.241918] gitaly[899]: time="2026-09-04T07:47:09.854Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5GMKP91FEHEN4RG5BQ0S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T07:47:39.131" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:09.832" grpc.time_ms=21.324 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=0b45fc7c12004a74b031dd4d3710eba5a1254657', in 0.11 seconds) (finished: subtest: push delivers the webhook, in 3.89 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses gitlab # [ 398.284509] nixbot[3928]: INFO: ::ffff:127.0.0.1:50600 - "GET /api/repos/gitlab/root/test-flake/builds?commit=0b45fc7c12004a74b031dd4d3710eba5a1254657 HTTP/1.1" 200 OK gitlab # [ 398.293799] gitaly[899]: time="2026-09-04T07:47:09.906Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=6 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5GMKP91FEHEN4RG5BQ0S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:19.135" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:09.886" grpc.time_ms=18.809 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 398.364924] gitaly[899]: time="2026-09-04T07:47:09.977Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5GMKP91FEHEN4RG5BQ0S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:19.208" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:09.959" grpc.time_ms=17.948 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 398.399907] gitaly[899]: time="2026-09-04T07:47:10.012Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5GZGMG8HEARS12P91852 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:40.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:10.010" grpc.time_ms=0.845 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses, in 0.19 seconds) gitlab # [ 398.473356] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 148 gitlab # [ 398.480152] gitaly[899]: time="2026-09-04T07:47:10.092Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5GMKP91FEHEN4RG5BQ0S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:47:20.041" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:10.092" grpc.time_ms=0.342 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 398.502067] gitaly[899]: time="2026-09-04T07:47:10.112Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5GMKP91FEHEN4RG5BQ0S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:47:20.051" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:10.102" grpc.time_ms=9.746 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 398.555135] gitaly[899]: time="2026-09-04T07:47:10.167Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP5GMKP91FEHEN4RG5BQ0S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:10.165" grpc.time_ms=2.377 pid=899 span.kind=server system=grpc gitlab # [ 398.595972] gitaly[899]: time="2026-09-04T07:47:10.208Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP5GMKP91FEHEN4RG5BQ0S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:10.207" grpc.time_ms=0.622 pid=899 span.kind=server system=grpc gitlab # [ 398.610013] gitaly[899]: time="2026-09-04T07:47:10.221Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5GMKP91FEHEN4RG5BQ0S diskcache=c2ce0423-ee7e-4bcc-b45f-4c995856973d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:47:20.065" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:10.115" pid=899 ref=refs/keep-around/0b45fc7c12004a74b031dd4d3710eba5a1254657 remote_ip="2001:db8:1::1" revision=0b45fc7c12004a74b031dd4d3710eba5a1254657 span.kind=server system=grpc username=root gitlab # [ 398.624912] gitaly[899]: time="2026-09-04T07:47:10.222Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=92 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5515 command.oublock=8 command.real_time_ms=97 command.spawn_token_fork_ms=1 command.system_time_ms=47 command.user_time_ms=45 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5GMKP91FEHEN4RG5BQ0S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:47:20.065" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:10.115" grpc.time_ms=105.923 pid=899 ref=refs/keep-around/0b45fc7c12004a74b031dd4d3710eba5a1254657 remote_ip="2001:db8:1::1" revision=0b45fc7c12004a74b031dd4d3710eba5a1254657 span.kind=server system=grpc username=root gitlab # [ 398.641988] gitaly[899]: time="2026-09-04T07:47:10.229Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5GMKP91FEHEN4RG5BQ0S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:40.027" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:10.228" grpc.time_ms=0.889 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 398.861225] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0b45fc7c12004a74b031dd4d3710eba5a1254657 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 886 gitlab # [ 398.869650] nixbot[3928]: {"ts": "2026-09-04T07:47:10.475Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0b45fc7c12004a74b031dd4d3710eba5a1254657 \"HTTP/1.1 201 Created\""} gitlab # [ 398.878365] nixbot[3928]: {"ts": "2026-09-04T07:47:10.489Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-0b45fc7c1200-0"} gitlab # [ 399.192998] nixbot[3928]: {"ts": "2026-09-04T07:47:10.805Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-0b45fc7c1200-0", "argv0": "bwrap"} gitlab # [ 399.386306] systemd[1]: Started Nix Daemon. gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses gitlab # [ 399.502004] nix-daemon[4162]: accepted connection from pid 4157, user nixbot gitlab # [ 399.602783] gitaly[899]: time="2026-09-04T07:47:11.214Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5J4SREZT6QYWP5QJK20G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:41.211" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:11.212" grpc.time_ms=1.208 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 399.827498] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 308 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses, in 0.36 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses gitlab # [ 400.995201] gitaly[899]: time="2026-09-04T07:47:12.606Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5KFKH9XA4DJNCH3AY8CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:42.404" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:12.604" grpc.time_ms=1.272 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses, in 0.23 seconds) gitlab # [ 401.058623] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 170 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses gitlab # [ 402.217137] gitaly[899]: time="2026-09-04T07:47:13.828Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5MP20AR64D7533ZQB63X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:43.025" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:13.826" grpc.time_ms=1.364 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses, in 0.21 seconds) gitlab # [ 402.276127] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 152 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses gitlab # [ 403.444379] gitaly[899]: time="2026-09-04T07:47:15.055Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5NW0V1MDJFBE6XAHAQQY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:45.053" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:15.053" grpc.time_ms=1.281 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses, in 0.24 seconds) gitlab # [ 403.506272] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 172 gitlab # [ 403.673991] nix-daemon[4162]: accepted connection from pid 4198, user nixbot gitlab # [ 403.701417] nix-daemon[4162]: accepted connection from pid 4157, user nixbot gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses gitlab # [ 404.673760] gitaly[899]: time="2026-09-04T07:47:16.285Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5Q2M29Q2TV27DS9C8M8G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:46.282" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:16.283" grpc.time_ms=1.686 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses, in 0.23 seconds) gitlab # [ 404.738861] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 168 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses gitlab # [ 405.911176] gitaly[899]: time="2026-09-04T07:47:17.522Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5R95A31TABKF0FD3ZBE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:47.019" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:17.520" grpc.time_ms=1.361 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses, in 0.23 seconds) gitlab # [ 405.971751] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 169 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses gitlab # [ 407.139658] gitaly[899]: time="2026-09-04T07:47:18.750Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5SFG7H8C9BG21FW9WG34 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:48.248" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:18.749" grpc.time_ms=1.3 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses, in 0.23 seconds) gitlab # [ 407.195620] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 166 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses gitlab # [ 408.364060] gitaly[899]: time="2026-09-04T07:47:19.975Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5TNTSYDM6A0933Y2GV00 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:49.272" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:19.973" grpc.time_ms=1.352 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses, in 0.23 seconds) gitlab # [ 408.421727] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 165 gitlab # [ 408.464673] nix-daemon[4162]: accepted connection from pid 4157, user nixbot gitlab # [ 408.666169] gitaly[899]: time="2026-09-04T07:47:20.278Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5TYZPJZ6JGNRZ0JBS7DR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:50.075" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:20.276" grpc.time_ms=1.304 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 408.784216] gitaly[899]: time="2026-09-04T07:47:20.396Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5TYZPJZ6JGNRZ0JBS7DR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:30.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:20.377" grpc.time_ms=18.965 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 408.892235] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0b45fc7c12004a74b031dd4d3710eba5a1254657 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 341 gitlab # [ 408.901879] nixbot[3928]: {"ts": "2026-09-04T07:47:20.503Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0b45fc7c12004a74b031dd4d3710eba5a1254657 \"HTTP/1.1 201 Created\""} gitlab # [ 409.029340] gitaly[899]: time="2026-09-04T07:47:20.641Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5VA02VN5GDE5114DS3HS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:50.439" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:20.640" grpc.time_ms=1.222 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 409.126667] gitaly[899]: time="2026-09-04T07:47:20.739Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5VA02VN5GDE5114DS3HS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:30.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:20.720" grpc.time_ms=18.493 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 409.227988] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0b45fc7c12004a74b031dd4d3710eba5a1254657 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 327 gitlab # [ 409.236160] nixbot[3928]: {"ts": "2026-09-04T07:47:20.842Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0b45fc7c12004a74b031dd4d3710eba5a1254657 \"HTTP/1.1 201 Created\""} gitlab # [ 409.371690] gitaly[899]: time="2026-09-04T07:47:20.983Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5VN0A6TVA3074ZRZFRA5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:50.180" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:20.981" grpc.time_ms=1.181 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses gitlab # [ 409.504415] gitaly[899]: time="2026-09-04T07:47:21.116Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5VN0A6TVA3074ZRZFRA5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:31.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:21.095" grpc.time_ms=20.839 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 409.573028] gitaly[899]: time="2026-09-04T07:47:21.185Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5VW7Z4T38BC2AVX3SBEY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:51.182" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:21.183" grpc.time_ms=1.441 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 409.628397] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses HTTP/1.1" 200 1313 "" "curl/8.21.0" 143 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses, in 0.21 seconds) gitlab # [ 409.697589] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0b45fc7c12004a74b031dd4d3710eba5a1254657 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 445 gitlab # [ 409.705862] nixbot[3928]: {"ts": "2026-09-04T07:47:21.312Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0b45fc7c12004a74b031dd4d3710eba5a1254657 \"HTTP/1.1 201 Created\""} gitlab # [ 410.187998] gitaly[899]: time="2026-09-04T07:47:21.800Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5WEEW1G5YHY63Y98J6DP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:21.781" grpc.time_ms=17.735 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 410.215188] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:21 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 122 gitlab # [ 410.341642] gitaly[899]: time="2026-09-04T07:47:21.953Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5WJBZZVP42KMJEDZH6ND grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:21.933" pid=899 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 410.369190] gitaly[899]: time="2026-09-04T07:47:21.954Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5WJBZZVP42KMJEDZH6ND grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:21.933" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 410.393656] gitlab-workhorse[826]: time="2026-09-04T07:47:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 410.396608] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:21 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 151 gitlab # [ 410.399972] gitaly[899]: time="2026-09-04T07:47:21.954Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5WJBZZVP42KMJEDZH6ND grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:21.933" grpc.time_ms=21.399 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 410.541221] gitaly[899]: time="2026-09-04T07:47:22.153Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP5WT80CJQD9FND37B7NH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:22.133" grpc.time_ms=19.335 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 410.559263] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:22 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 96 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses gitlab # [ 410.681009] gitaly[899]: time="2026-09-04T07:47:22.293Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5WXDYYEVARTSA2V0EJ67 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:22.275" pid=899 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc gitlab # [ 410.708883] gitaly[899]: time="2026-09-04T07:47:22.293Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5WXDYYEVARTSA2V0EJ67 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:22.275" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 410.741081] gitlab-workhorse[826]: time="2026-09-04T07:47:22Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 410.744510] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:22 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 138 gitlab # [ 410.747746] gitaly[899]: time="2026-09-04T07:47:22.300Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5WXDYYEVARTSA2V0EJ67 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:22.275" grpc.time_ms=18.498 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 410.769760] gitaly[899]: time="2026-09-04T07:47:22.382Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP5X26YWRJVRJ34AVK8S3C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:47:52.178" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:22.378" grpc.time_ms=3.158 pid=899 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses, in 0.20 seconds) gitlab # [ 410.826323] gitlab-workhorse[826]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/0b45fc7c12004a74b031dd4d3710eba5a1254657/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 128 (finished: subtest: eval and build post commit statuses, in 12.55 seconds) (finished: run the VM test script, in 527.13 seconds) test script finished in 527.18s cleanup kill QemuMachine (pid 46) gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14) (finished: cleanup, in 2.06 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-04T07:47:05.591Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [{'id': 1, 'project_id': 1, 'number': 1, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '0b45fc7c12004a74b031dd4d3710eba5a1254657', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-04T07:47:09.567104Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}] [] [{'id': 1, 'sha': '0b45fc7c12004a74b031dd4d3710eba5a1254657', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:10.415Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '0b45fc7c12004a74b031dd4d3710eba5a1254657', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:10.415Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '0b45fc7c12004a74b031dd4d3710eba5a1254657', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:10.415Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '0b45fc7c12004a74b031dd4d3710eba5a1254657', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:10.415Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '0b45fc7c12004a74b031dd4d3710eba5a1254657', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:10.415Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '0b45fc7c12004a74b031dd4d3710eba5a1254657', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:10.415Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '0b45fc7c12004a74b031dd4d3710eba5a1254657', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:10.415Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '0b45fc7c12004a74b031dd4d3710eba5a1254657', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:10.415Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '0b45fc7c12004a74b031dd4d3710eba5a1254657', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-04T07:47:10.415Z', 'started_at': None, 'finished_at': '2026-09-04T07:47:20.445Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': '0b45fc7c12004a74b031dd4d3710eba5a1254657', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'building attributes', 'created_at': '2026-09-04T07:47:20.793Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '0b45fc7c12004a74b031dd4d3710eba5a1254657', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-04T07:47:10.415Z', 'started_at': None, 'finished_at': '2026-09-04T07:47:20.445Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': '0b45fc7c12004a74b031dd4d3710eba5a1254657', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': '0 attributes built', 'created_at': '2026-09-04T07:47:20.793Z', 'started_at': None, 'finished_at': '2026-09-04T07:47:21.238Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]