tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.cScNeQTdvK', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) (finished: start all VMs, in 71.10 seconds) gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for unit setup-gitlab.service gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab: waiting for the VM to finish booting gitlab # Filesystem UUID: 1a9e1b79-9531-4e15-b386-b4f13ea7d2f6 gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] KASLR enabled gitlab # [ 0.000000] random: crng init done gitlab # [ 0.000000] Machine model: linux,dummy-virt gitlab # [ 0.000000] efi: UEFI not found. gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf] gitlab # [ 0.000000] Zone ranges: gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff] gitlab # [ 0.000000] DMA32 empty gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.000000] Device empty gitlab # [ 0.000000] Movable zone start for each node gitlab # [ 0.000000] Early memory node ranges gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe000000 gitlab # [ 0.000000] psci: probing for conduit method from DT. gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware. gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs gitlab # [ 0.000000] psci: Trusted OS migration not required gitlab # [ 0.000000] psci: SMC Calling Convention v1.1 gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 gitlab # [ 0.000000] Detected PIPT I-cache on CPU0 gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface gitlab # [ 0.000000] CPU features: detected: Spectre-v4 gitlab # [ 0.000000] CPU features: detected: Spectre-BHB gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 gitlab # [ 0.000000] alternatives: applying boot alternatives gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/525ij963vvcchlzrd3ykllvvh5aagrjr-nixos-system-gitlab-test/init regInfo=/nix/store/nrranv6fc758s7rc37rr4055mfclai6f-closure-info/registration console=ttyAMA0,115200n8 console=tty0 gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/nrranv6fc758s7rc37rr4055mfclai6f-closure-info/registration", will be passed to user space. gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.000000] software IO TLB: area num 4. gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB) gitlab # [ 0.000000] Fallback order for Node 0: 0 gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1572864 gitlab # [ 0.000000] Policy zone: Normal gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.000000] allocated 12582912 bytes of page_ext gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups gitlab # [ 0.000000] rcu: Hierarchical RCU implementation. gitlab # [ 0.000000] rcu: RCU event tracing is enabled. gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.000000] Rude variant of Tasks RCU enabled. gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled. gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 gitlab # [ 0.000000] GICv3: 256 SPIs implemented gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000 gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000 gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns gitlab # [ 0.000028] arm-pv: using stolen time PV gitlab # [ 0.000381] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.000550] Console: colour dummy device 80x25 gitlab # [ 0.000556] printk: legacy console [tty0] enabled gitlab # [ 0.000738] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) gitlab # [ 0.000744] pid_max: default: 32768 minimum: 301 gitlab # [ 0.000836] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.000964] landlock: Up and running. gitlab # [ 0.000967] Yama: becoming mindful. gitlab # [ 0.001373] LSM support for eBPF active gitlab # [ 0.001549] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.001648] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.002743] cacheinfo: Unable to detect cache hierarchy for CPU 0 gitlab # [ 0.003403] rcu: Hierarchical SRCU implementation. gitlab # [ 0.003407] rcu: Max phase no-delay instances is 1000. gitlab # [ 0.003571] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.004558] fsl-mc MSI: its@8080000 domain created gitlab # [ 0.004651] EFI services will not be available. gitlab # [ 0.004807] smp: Bringing up secondary CPUs ... gitlab # [ 0.005417] Detected PIPT I-cache on CPU1 gitlab # [ 0.005515] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000 gitlab # [ 0.005637] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000 gitlab # [ 0.005759] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40] gitlab # [ 0.006782] Detected PIPT I-cache on CPU2 gitlab # [ 0.006886] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000 gitlab # [ 0.007009] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000 gitlab # [ 0.007132] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40] gitlab # [ 0.008154] Detected PIPT I-cache on CPU3 gitlab # [ 0.008266] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000 gitlab # [ 0.008389] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000 gitlab # [ 0.008513] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40] gitlab # [ 0.009000] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.009025] SMP: Total of 4 processors activated. gitlab # [ 0.009027] CPU: All CPU(s) started at EL1 gitlab # [ 0.009035] CPU features: detected: Branch Target Identification gitlab # [ 0.009039] CPU features: detected: ARMv8.4 Translation Table Level gitlab # [ 0.009042] CPU features: detected: Instruction cache invalidation not required for I/D coherence gitlab # [ 0.009045] CPU features: detected: Data cache clean to the PoU not required for I/D coherence gitlab # [ 0.009049] CPU features: detected: Common not Private translations gitlab # [ 0.009051] CPU features: detected: CRC32 instructions gitlab # [ 0.009054] CPU features: detected: Data cache clean to Point of Deep Persistence gitlab # [ 0.009057] CPU features: detected: Data cache clean to Point of Persistence gitlab # [ 0.009060] CPU features: detected: Data independent timing control (DIT) gitlab # [ 0.009062] CPU features: detected: E0PD gitlab # [ 0.009065] CPU features: detected: Enhanced Counter Virtualization gitlab # [ 0.009067] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) gitlab # [ 0.009070] CPU features: detected: Enhanced Virtualization Traps gitlab # [ 0.009073] CPU features: detected: Fine Grained Traps gitlab # [ 0.009076] CPU features: detected: Generic authentication (architected QARMA5 algorithm) gitlab # [ 0.009079] CPU features: detected: RCpc load-acquire (LDAPR) gitlab # [ 0.009082] CPU features: detected: LSE atomic instructions gitlab # [ 0.009084] CPU features: detected: Privileged Access Never gitlab # [ 0.009086] CPU features: detected: PMUv3 gitlab # [ 0.009089] CPU features: detected: RAS Extension Support gitlab # [ 0.009091] CPU features: detected: RASv1p1 Extension Support gitlab # [ 0.009094] CPU features: detected: Random Number Generator gitlab # [ 0.009096] CPU features: detected: Speculation barrier (SB) gitlab # [ 0.009098] CPU features: detected: Stage-2 Force Write-Back gitlab # [ 0.009101] CPU features: detected: TLB range maintenance instructions gitlab # [ 0.009104] CPU features: detected: Speculative Store Bypassing Safe (SSBS) gitlab # [ 0.009239] alternatives: applying system-wide alternatives gitlab # [ 0.012047] CPU features: detected: BBM Level 2 without TLB conflict abort gitlab # [ 0.012261] Memory: 5963764K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved) gitlab # [ 0.013651] devtmpfs: initialized gitlab # [ 0.017756] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.017821] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.018006] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL gitlab # [ 0.018011] 0 pages in range for non-PLT usage gitlab # [ 0.018012] 508288 pages in range for PLT usage gitlab # [ 0.018130] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.018922] DMI not present or invalid. gitlab # [ 0.021983] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.024506] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.024788] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.026492] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.026514] audit: initializing netlink subsys (disabled) gitlab # [ 0.026828] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.027278] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.027281] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.027287] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.027290] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.027292] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.027373] cpuidle: using governor ladder gitlab # [ 0.027397] cpuidle: using governor menu gitlab # [ 0.027597] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. gitlab # [ 0.027811] ASID allocator initialised with 65536 entries gitlab # [ 0.029030] Serial: AMBA PL011 UART driver gitlab # [ 0.034346] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 gitlab # [ 0.034644] printk: console [ttyAMA0] enabled gitlab # [ 0.047112] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.047134] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.047144] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages gitlab # [ 0.047152] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page gitlab # [ 0.047160] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.047168] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.047177] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages gitlab # [ 0.047185] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page gitlab # [ 0.059033] fbcon: Taking over console gitlab # [ 0.059059] ACPI: Interpreter disabled. gitlab # [ 0.061758] iommu: Default domain type: Translated gitlab # [ 0.061767] iommu: DMA domain TLB invalidation policy: strict mode gitlab # [ 0.091817] SCSI subsystem initialized gitlab # [ 0.092450] usbcore: registered new interface driver usbfs gitlab # [ 0.092504] usbcore: registered new interface driver hub gitlab # [ 0.092533] usbcore: registered new device driver usb gitlab # [ 0.093001] pps_core: LinuxPPS API ver. 1 registered gitlab # [ 0.093007] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti gitlab # [ 0.093021] PTP clock support registered gitlab # [ 0.093096] EDAC MC: Ver: 3.0.0 gitlab # [ 0.093533] scmi_core: SCMI protocol bus registered gitlab # [ 0.094362] FPGA manager framework gitlab # [ 0.095471] vgaarb: loaded gitlab # [ 0.096776] clocksource: Switched to clocksource arch_sys_counter gitlab # [ 0.101421] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.101460] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.103077] netfs: FS-Cache loaded gitlab # [ 0.103810] pnp: PnP ACPI: disabled gitlab # [ 0.115603] NET: Registered PF_INET protocol family gitlab # [ 0.118080] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.174617] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.174688] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.174749] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.175187] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.176097] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.176228] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.176305] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.176486] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.176748] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.176836] NET: Registered PF_XDP protocol family gitlab # [ 0.176857] PCI: CLS 0 bytes, default 64 gitlab # [ 0.177205] Trying to unpack rootfs image as initramfs... gitlab # [ 0.185549] kvm [1]: HYP mode not available gitlab # [ 0.252197] Initialise system trusted keyrings gitlab # [ 0.252556] workingset: timestamp_bits=42 max_order=21 bucket_order=0 gitlab # [ 0.253304] squashfs: version 4.0 (2009/01/31) Phillip Lougher gitlab # [ 0.253451] 9p: Installing v9fs 9p2000 file system support gitlab # [ 0.268170] Key type asymmetric registered gitlab # [ 0.268175] Asymmetric key parser 'x509' registered gitlab # [ 0.268246] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) gitlab # [ 0.268541] io scheduler mq-deadline registered gitlab # [ 0.268546] io scheduler kyber registered gitlab # [ 0.273806] pl061_gpio 9030000.pl061: PL061 GPIO chip registered gitlab # [ 0.276971] ledtrig-cpu: registered to indicate activity on CPUs gitlab # [ 0.277553] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: gitlab # [ 0.277571] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 gitlab # [ 0.277585] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 gitlab # [ 0.277592] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 gitlab # [ 0.277626] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits gitlab # [ 0.277653] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] gitlab # [ 0.277742] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 gitlab # [ 0.277752] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.277757] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] gitlab # [ 0.277762] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] gitlab # [ 0.277766] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] gitlab # [ 0.277900] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.278718] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.279096] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.279119] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.279177] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.279200] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.280061] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.280427] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.280445] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.280486] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.281456] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.281919] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.281936] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.281975] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.282807] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.283222] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.283238] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.283290] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.284195] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.284569] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.284587] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.284635] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.285602] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.285956] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.285980] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.286038] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.286932] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.287302] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.287326] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.287384] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.287407] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.288367] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint gitlab # [ 0.288748] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.288804] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.289760] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.290174] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.290232] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.291009] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint gitlab # [ 0.291408] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] gitlab # [ 0.291887] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.292396] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] gitlab # [ 0.292415] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.292463] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.293411] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.293832] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.293850] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.293889] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.295010] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned gitlab # [ 0.295019] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned gitlab # [ 0.295024] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned gitlab # [ 0.295107] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned gitlab # [ 0.295174] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned gitlab # [ 0.295238] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned gitlab # [ 0.295301] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned gitlab # [ 0.295377] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned gitlab # [ 0.295441] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned gitlab # [ 0.295527] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned gitlab # [ 0.295602] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned gitlab # [ 0.295692] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned gitlab # [ 0.295795] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned gitlab # [ 0.295869] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned gitlab # [ 0.295895] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned gitlab # [ 0.295921] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned gitlab # [ 0.295948] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned gitlab # [ 0.295975] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned gitlab # [ 0.296000] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned gitlab # [ 0.296033] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned gitlab # [ 0.296059] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned gitlab # [ 0.296091] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned gitlab # [ 0.296119] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned gitlab # [ 0.296146] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned gitlab # [ 0.296173] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned gitlab # [ 0.296198] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned gitlab # [ 0.296234] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned gitlab # [ 0.296269] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned gitlab # [ 0.296304] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned gitlab # [ 0.296330] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned gitlab # [ 0.296356] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned gitlab # [ 0.296382] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned gitlab # [ 0.296408] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned gitlab # [ 0.296434] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned gitlab # [ 0.296472] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] gitlab # [ 0.296479] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] gitlab # [ 0.296484] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] gitlab # [ 0.299203] pci 0000:00:0a.0: enabling device (0000 -> 0002) gitlab # [ 0.315772] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) gitlab # [ 0.318364] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) gitlab # [ 0.320767] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) gitlab # [ 0.323269] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) gitlab # [ 0.325989] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) gitlab # [ 0.331386] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) gitlab # [ 0.333908] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) gitlab # [ 0.336421] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) gitlab # [ 0.338981] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) gitlab # [ 0.343008] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) gitlab # [ 0.346702] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) gitlab # [ 0.354180] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.356596] msm_serial: driver initialized gitlab # [ 0.356834] SuperH (H)SCI(F) driver initialized gitlab # [ 0.356896] STM32 USART driver initialized gitlab # [ 0.377867] loop: module loaded gitlab # [ 0.378051] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 0.380133] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 0.382124] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 0.384093] virtio_blk virtio5: [vdb] 12143584 512-byte logical blocks (6.22 GB/5.79 GiB) gitlab # [ 0.386403] megasas: 07.734.00.00-rc1 gitlab # [ 0.387138] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] gitlab # [ 0.389022] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.389039] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.390738] Using buffer write method gitlab # [ 0.390772] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] gitlab # [ 0.392637] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.392653] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.394260] Using buffer write method gitlab # [ 0.394272] Concatenating MTD devices: gitlab # [ 0.394275] (0): "0.flash" gitlab # [ 0.394277] (1): "0.flash" gitlab # [ 0.394279] into device "0.flash" gitlab # [ 0.614309] Freeing initrd memory: 27184K gitlab # [ 0.629536] tun: Universal TUN/TAP device driver, 1.6 gitlab # [ 0.638206] thunder_xcv, ver 1.0 gitlab # [ 0.638305] thunder_bgx, ver 1.0 gitlab # [ 0.638372] nicpf, ver 1.0 gitlab # [ 0.640016] e1000: Intel(R) PRO/1000 Network Driver gitlab # [ 0.640027] e1000: Copyright (c) 1999-2006 Intel Corporation. gitlab # [ 0.640096] e1000e: Intel(R) PRO/1000 Network Driver gitlab # [ 0.640111] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. gitlab # [ 0.640185] igb: Intel(R) Gigabit Ethernet Network Driver gitlab # [ 0.640194] igb: Copyright (c) 2007-2014 Intel Corporation. gitlab # [ 0.640268] igbvf: Intel(R) Gigabit Virtual Function Network Driver gitlab # [ 0.640279] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. gitlab # [ 0.640663] sky2: driver version 1.30 gitlab # [ 0.645392] usbcore: registered new interface driver usb-storage gitlab # [ 0.645623] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.645666] usbserial: USB Serial support registered for generic gitlab # [ 0.645890] ehci-pci 0000:00:0a.0: EHCI Host Controller gitlab # [ 0.645974] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 gitlab # [ 0.646789] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 gitlab # [ 0.647508] hv_vmbus: registering driver hyperv_keyboard gitlab # [ 0.650216] rtc-pl031 9010000.pl031: registered as rtc0 gitlab # [ 0.650273] rtc-pl031 9010000.pl031: setting system clock to 2026-08-11T10:07:49 UTC (1786442869) gitlab # [ 0.651166] i2c_dev: i2c /dev entries driver gitlab # [ 0.656883] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 gitlab # [ 0.658295] hub 1-0:1.0: USB hub found gitlab # [ 0.658509] hub 1-0:1.0: 6 ports detected gitlab # [ 0.659598] sdhci: Secure Digital Host Controller Interface driver gitlab # [ 0.659613] sdhci: Copyright(c) Pierre Ossman gitlab # [ 0.660448] Synopsys Designware Multimedia Card Interface Driver gitlab # [ 0.661661] sdhci-pltfm: SDHCI platform and OF driver helper gitlab # [ 0.666578] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 0.667600] usbcore: registered new interface driver usbhid gitlab # [ 0.667614] usbhid: USB HID core driver gitlab # [ 0.697779] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available gitlab # [ 0.702543] drop_monitor: Initializing network drop monitor service gitlab # [ 0.702922] NET: Registered PF_INET6 protocol family gitlab # [ 0.705494] Segment Routing with IPv6 gitlab # [ 0.705534] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.705646] NET: Registered PF_PACKET protocol family gitlab # [ 0.705988] 9pnet: Installing 9P2000 support gitlab # [ 0.710395] Key type dns_resolver registered gitlab # [ 0.730073] registered taskstats version 1 gitlab # [ 0.730650] Loading compiled-in X.509 certificates gitlab # [ 0.752483] Demotion targets for Node 0: null gitlab # [ 0.752706] Key type .fscrypt registered gitlab # [ 0.752713] Key type fscrypt-provisioning registered gitlab # [ 0.752976] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 0.752999] ima: Allocated hash algorithm: sha1 gitlab # [ 0.753048] ima: No architecture policies found gitlab # [ 0.754185] input: gpio-keys as /devices/platform/gpio-keys/input/input0 gitlab # [ 0.781690] clk: Disabling unused clocks gitlab # [ 0.781722] PM: genpd: Disabling unused power domains gitlab # [ 0.787289] Freeing unused kernel memory: 4736K gitlab # [ 0.787527] Run /init as init process gitlab # [ 0.820073] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 0.912852] usb 1-1: new high-speed USB device number 2 using ehci-pci gitlab # [ 1.065203] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 gitlab # [ 1.154612] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.154680] systemd[1]: Detected virtualization qemu. gitlab # [ 1.154758] systemd[1]: Detected architecture arm64. gitlab # [ 1.154775] systemd[1]: Running in initrd. gitlab # [ 1.155625] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.155886] systemd[1]: Hostname set to . gitlab # [ 1.157308] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 gitlab # [ 1.276846] usb 1-2: new high-speed USB device number 3 using ehci-pci gitlab # [ 1.386592] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.440984] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 gitlab # [ 1.441340] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 gitlab # [ 1.477189] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.496325] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.496631] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.496672] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.496689] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.496719] systemd[1]: Reached target Path Units. gitlab # [ 1.496740] systemd[1]: Reached target Slice Units. gitlab # [ 1.496762] systemd[1]: Reached target Swaps. gitlab # [ 1.496868] systemd[1]: Reached target Timer Units. gitlab # [ 1.497130] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.497341] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.497539] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.497729] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.497843] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.497871] systemd[1]: Reached target Socket Units. gitlab # [ 1.500033] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.502379] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.502470] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 1.504759] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 1.532804] systemd[1]: Starting Journal Service... gitlab # [ 1.537009] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.537156] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.540977] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 1.547715] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 1.550273] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.550701] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.551288] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 1.560942] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 1.578276] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 1.582054] systemd-journald[95]: Collecting audit messages is disabled. gitlab # [ 1.588245] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 gitlab # [ 1.588423] [drm] features: -virgl +edid -resource_blob -host_visible gitlab # [ 1.588438] [drm] features: -context_init gitlab # [ 1.589006] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.590134] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 1.590513] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 1.593902] [drm] number of scanouts: 1 gitlab # [ 1.593935] [drm] number of cap sets: 0 gitlab # [ 1.597633] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic gitlab # [ 1.597649] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 gitlab # [ 1.604349] Console: switching to colour frame buffer device 160x50 gitlab # [ 1.611009] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device gitlab # [ 1.613143] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.613618] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.614150] systemd[1]: Reached target Local File Systems. gitlab # [ 1.618243] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.641348] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.644416] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.660410] systemd[1]: Started Journal Service. gitlab # [ 1.656720] systemd-modules-load[96]: Using 4 probe threads gitlab # [ 1.659439] systemd-modules-load[96]: Module 'virtio_balloon' is built in gitlab # [ 1.660784] systemd-modules-load[96]: Module 'virtio_console' is built in gitlab # [ 1.662006] systemd-modules-load[96]: Module 'virtio_rng' is built in gitlab # [ 1.663205] systemd-modules-load[96]: Inserted module 'dm_mod' gitlab # [ 1.664282] systemd-modules-load[96]: Inserted module 'virtio_gpu' gitlab # [ 1.666022] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.672106] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.675974] systemd-udevd[106]: Using default interface naming scheme 'v261'. gitlab # [ 1.684969] systemd[1]: Finished Create System Files and Directories. gitlab # [ 1.696882] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 1.717629] systemd[1]: Starting Virtual Console Setup... gitlab # [ 1.761761] systemd-vconsole-setup[130]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 1.766785] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.218601] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.219912] systemd[1]: Reached target System Initialization. gitlab # [ 2.220899] systemd[1]: Reached target Basic System. gitlab # [ 2.421191] (udev-worker)[139]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.426447] (udev-worker)[139]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.449279] (udev-worker)[121]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.472172] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.473348] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.475631] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.481198] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.520398] systemd-fsck[154]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.529681] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.539071] systemd[1]: Mounting /sysroot... gitlab # [ 2.576350] EXT4-fs (vda): mounted filesystem 1a9e1b79-9531-4e15-b386-b4f13ea7d2f6 r/w with ordered data mode. Quota mode: none. gitlab # [ 2.574721] systemd[1]: Mounted /sysroot. gitlab # [ 2.575639] systemd[1]: Reached target Initrd Root File System. gitlab # [ 2.580655] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 2.581912] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 2.596255] systemd[1]: Mounting /sysroot/run... gitlab # [ 2.601850] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 2.608291] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 2.611914] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 2.617763] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 2.632032] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 2.635355] systemd[1]: Mounted /sysroot/run. gitlab # [ 2.637564] systemd-sysroot-fstab-check[169]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 2.650945] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 2.651862] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 2.652695] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 2.658341] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 2.659858] systemd[1]: Reload requested from client PID 169 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 2.661749] systemd[1]: Reloading... gitlab # [ 2.766224] systemd[1]: Reloading finished in 105 ms. gitlab # [ 2.826282] systemd-sysroot-fstab-check[169]: Requesting initrd-fs.target/start/replace... gitlab # [ 2.827484] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 2.828864] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 2.829726] systemd-sysroot-fstab-check[169]: Requesting swap.target/start/replace... gitlab # [ 2.831498] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 2.834876] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 2.835903] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 2.836973] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 2.850422] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 2.852052] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.013489] (udev-worker)[139]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory gitlab # [ 3.016668] (udev-worker)[139]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory gitlab # [ 3.020984] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.022063] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.022838] systemd[1]: Stopping Virtual Console Setup... gitlab # [ 3.023600] systemd[1]: Starting Virtual Console Setup... gitlab # [ 3.062147] systemd-vconsole-setup[198]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 3.064430] systemd[1]: Finished Virtual Console Setup. gitlab # [ 3.544951] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.615779] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.618276] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.620831] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.623493] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.683001] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.687089] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.710476] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.713005] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.715566] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 3.770151] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 3.772841] systemd[1]: Stopped target Basic System. gitlab # [ 3.775060] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 3.777618] systemd[1]: Stopped target Path Units. gitlab # [ 3.779806] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 3.783259] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 3.786779] systemd[1]: Stopped target Slice Units. gitlab # [ 3.789058] systemd[1]: Stopped target Socket Units. gitlab # [ 3.791298] systemd[1]: Stopped target System Initialization. gitlab # [ 3.797013] systemd[1]: Stopped target Swaps. gitlab # [ 3.800782] systemd[1]: Stopped target Timer Units. gitlab # [ 3.804480] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 3.809688] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 3.813963] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 3.817841] systemd[1]: Stopped Find NixOS closure. gitlab # [ 3.820084] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 3.822773] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.825699] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 3.828395] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 3.830480] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 3.833312] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 3.835139] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 3.837974] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 3.840401] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 3.842664] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 3.844493] systemd[1]: Stopped target Local File Systems. gitlab # [ 3.846072] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 3.847981] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 3.851132] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 3.852725] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 3.854753] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.856808] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.858224] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 3.860097] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 3.861855] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 3.863801] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 3.865558] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.867506] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.869393] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 3.871407] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 3.873483] systemd[1]: systemd-udevd.service: Consumed 2.235s CPU time over 2.226s wall clock time, 30.9M memory peak. gitlab # [ 3.876265] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 3.878194] systemd[1]: Closed udev Control Socket. gitlab # [ 3.879586] systemd[1]: Starting Cleanup udev Database... gitlab # [ 3.881147] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 3.883208] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 3.884977] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 3.887162] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 3.889067] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 3.890865] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 3.941362] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 3.942962] systemd[1]: Finished Cleanup udev Database. gitlab # [ 3.944000] systemd[1]: Reached target Switch Root. gitlab # [ 3.946139] systemd[1]: Starting NixOS Activation... gitlab # [ 4.126011] initrd-nixos-activation-start[223]: booting system configuration /nix/store/525ij963vvcchlzrd3ykllvvh5aagrjr-nixos-system-gitlab-test gitlab # [ 4.200663] initrd-nixos-activation-start[223]: running activation script... gitlab # [ 4.514899] initrd-nixos-activation-start[246]: setting up /etc... gitlab # [ 4.687527] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.691045] systemd[1]: Finished NixOS Activation. gitlab # [ 4.693338] systemd[1]: Starting Switch Root... gitlab # [ 4.751723] systemd[1]: Switching root. gitlab # [ 4.861329] systemd-journald[95]: Received SIGTERM from PID 1 (systemd). gitlab # [ 5.469831] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.469969] systemd[1]: Detected virtualization qemu. gitlab # [ 5.470040] systemd[1]: Detected architecture arm64. gitlab # [ 5.470215] systemd[1]: Detected first boot. gitlab # [ 5.471575] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.698964] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.834031] systemd[1]: Applying preset policy. gitlab # [ 6.110822] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 6.263270] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 6.263666] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 6.265793] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 6.273494] systemd[1]: Created slice Slice /system/getty. gitlab # [ 6.277436] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 6.281594] systemd[1]: Created slice User and Session Slice. gitlab # [ 6.283022] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 6.284394] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 6.285605] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 6.286608] systemd[1]: Expecting device /dev/ttyAMA0... gitlab # [ 6.287634] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 6.288687] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 6.289800] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 6.290859] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 6.291968] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 6.293085] systemd[1]: Reached target Path Units. gitlab # [ 6.294154] systemd[1]: Reached target Remote File Systems. gitlab # [ 6.295206] systemd[1]: Reached target Slice Units. gitlab # [ 6.296269] systemd[1]: Reached target Swaps. gitlab # [ 6.300133] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 6.304244] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 6.307216] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 6.310799] systemd[1]: Listening on Factory Reset Management. gitlab # [ 6.312159] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 6.321015] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 6.323275] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 6.327422] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 6.329079] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 6.330192] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.331208] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 6.337480] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 6.338815] systemd[1]: Listening on udev Control Socket. gitlab # [ 6.340203] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 6.381456] systemd[1]: Mounting Huge Pages File System... gitlab # [ 6.386722] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 6.392430] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 6.399895] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 6.410842] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 6.419861] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 6.421149] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 6.431232] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.433251] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 6.437062] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.447243] systemd[1]: Starting Load Kernel Module fuse... gitlab # [ 6.448017] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.468173] systemd[1]: Starting Journal Service... gitlab # [ 6.475369] systemd[1]: Starting Load Kernel Modules... gitlab # [ 6.485062] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 6.487496] fuse: init (API version 7.45) gitlab # [ 6.500834] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 6.502516] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.514689] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 6.522290] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 6.523244] systemd[1]: Mounted Huge Pages File System. gitlab # [ 6.524149] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 6.525073] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 6.525975] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 6.532709] systemd-journald[317]: Collecting audit messages is enabled. gitlab # [ 6.536166] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 6.538093] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 6.539578] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 6.541001] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 6.541884] EXT4-fs (vda): re-mounted 1a9e1b79-9531-4e15-b386-b4f13ea7d2f6. gitlab # [ 6.542468] systemd[1]: modprobe@fuse.service: Deactivated successfully. gitlab # [ 6.543751] systemd[1]: Finished Load Kernel Module fuse. gitlab # [ 6.545207] systemd[1]: Finished Load Kernel Modules. gitlab # [ 6.557154] systemd[1]: Mounting FUSE Control File System... gitlab # [ 6.565185] systemd[1]: Starting Firewall... gitlab # [ 6.572743] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 6.582291] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 6.581580] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 6.583765] systemd[1]: systemd-journald.service: Deactivated successfully.[ 6.588641] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # gitlab # [ 6.588984] systemd-modules-load[318]: Using 3 probe threads gitlab # [ 6.590955] systemd-modules-load[318]: Module 'atkbd' is built in gitlab # [ 6.593038] systemd-modules-load[318]: Module 'loop' is built in gitlab # [ 6.595191] systemd-modules-load[318]: Inserted module 'tls' gitlab # [ 6.597869] systemd-oomd[320]: No swap; memory pressure usage will be degraded gitlab # [ 6.607698] systemd[1]: Started Journal Service. gitlab # [ 6.607395] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 6.609935] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 6.617796] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 6.619203] systemd[1]: Mounted FUSE Control File System. gitlab # [ 6.623611] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 6.627452] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 6.628721] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.630646] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.631543] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.653678] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.660285] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.670720] systemd-journald[317]: Received client request to flush runtime journal. gitlab # [ 6.698552] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 6.701628] systemd[1]: Reached target First Boot Complete. gitlab # [ 6.703076] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 6.704320] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 6.705825] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 6.706954] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 6.753396] systemd-udevd[372]: Using default interface naming scheme 'v261'. gitlab # [ 6.786232] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 7.014183] systemd[1]: Finished Firewall. gitlab # [ 7.209331] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 7.265608] systemd[1]: Mounting /run/wrappers... gitlab # [ 7.304206] systemd[1]: Mounted /run/wrappers. gitlab # [ 7.306492] systemd[1]: Reached target Local File Systems. gitlab # [ 7.312512] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 7.321044] systemd[1]: Starting register-nix-paths.service... gitlab # [ 7.324623] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 7.327822] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.329491] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 7.351101] systemd[1]: Starting Create System Files and Directories... gitlab # [ 7.360583] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 7.388625] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 7.406963] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 7.412267] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 7.421311] systemd[1]: Finished Create System Files and Directories. gitlab # [ 7.428392] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 7.432274] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 7.464799] (udev-worker)[423]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.469919] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 7.471409] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. gitlab # [ 7.480909] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 7.487363] systemd[1]: Starting Update is Completed... gitlab # [ 7.489533] (udev-worker)[474]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 7.493116] (udev-worker)[474]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.520179] systemd[1]: Finished Update is Completed. gitlab # [ 7.532643] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 7.534401] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 7.537826] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.539154] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 7.541987] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 7.544189] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.545751] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.575691] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 7.577189] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.578262] systemd[1]: suid-sgid-wrappers.service: Consumed 151ms CPU time over 250ms wall clock time, 6.4M memory peak, 1.9M read from disk. gitlab # [ 7.609677] mousedev: PS/2 mouse device common for all mice gitlab # [ 7.821247] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.823542] systemd[1]: Reached target System Initialization. gitlab # [ 7.826930] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.828851] systemd[1]: Started logrotate.timer. gitlab # [ 7.829655] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.830640] systemd[1]: Reached target Timer Units. gitlab # [ 7.831422] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.832650] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.841460] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.843879] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.845255] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.846495] systemd[1]: Reached target Socket Units. gitlab # [ 7.848219] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.882479] dbus-broker-launch[559]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.884002] dbus-broker-launch[559]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.885493] dbus-broker-launch[559]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.888094] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.900279] dbus-broker-launch[559]: Ready gitlab # [ 7.901427] systemd[1]: Reached target Basic System. gitlab # [ 7.903288] systemd[1]: Started backdoor.service. gitlab # [ 7.908468] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.924381] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.928058] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.935291] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # connecting to host... gitlab # [ 7.941927] systemd[1]: Starting Post-Boot Actions... gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.973856] logrotate[564]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab: connected to guest root shell gitlab # [ 7.976369] logrotate[564]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf gitlab: (connecting took 8.42 seconds) gitlab # [ 7.977581] logrotate[564]: note: 'monthly' overrides previously specified 'weekly' gitlab: (finished: waiting for the VM to finish booting, in 8.42 seconds) gitlab # [ 7.978589] logrotate[564]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.979519] logrotate[564]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.985167] logrotate[564]: Allocating hash table for state file, size 64 entries gitlab # [ 7.986185] logrotate[564]: Handling 4 logs gitlab # [ 7.988551] logrotate[564]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.995861] logrotate[564]: considering log /var/log/btmp gitlab # [ 7.996741] logrotate[564]: Creating new state gitlab # [ 7.997368] logrotate[564]: Now: 2026-08-11 10:07 gitlab # [ 7.998037] logrotate[564]: Last rotated at 2026-08-11 10:00 gitlab # [ 7.998826] logrotate[564]: log does not need rotating (log has already been rotated) gitlab # [ 7.999884] logrotate[564]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 8.002118] logrotate[564]: considering log /var/log/wtmp gitlab # [ 8.002841] logrotate[564]: Creating new state gitlab # [ 8.003446] logrotate[564]: Now: 2026-08-11 10:07 gitlab # [ 8.005865] logrotate[564]: Last rotated at 2026-08-11 10:00 gitlab # [ 8.006772] logrotate[564]: log does not need rotating (log has already been rotated) gitlab # [ 8.007891] logrotate[564]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 8.009968] logrotate[564]: switching euid from 0 to 165 and egid from 0 to 165 (pid 564) gitlab # [ 8.011043] logrotate[564]: considering log /var/gitlab/state/log/*.log gitlab # [ 8.011974] logrotate[564]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 8.013514] logrotate[564]: Creating new state gitlab # [ 8.014788] logrotate[564]: switching euid from 165 to 0 and egid from 165 to 0 (pid 564) gitlab # [ 8.017286] logrotate[564]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 8.019137] logrotate[564]: switching euid from 0 to 60 and egid from 0 to 60 (pid 564) gitlab # [ 8.020459] logrotate[564]: considering log /var/log/nginx/*.log gitlab # [ 8.021369] logrotate[564]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 8.022382] logrotate[564]: Creating new state gitlab # [ 8.023017] logrotate[564]: not running postrotate script, since no logs were rotated gitlab # [ 8.024287] logrotate[564]: switching euid from 60 to 0 and egid from 60 to 0 (pid 564) gitlab # [ 8.025599] systemd[1]: Started Reset console on configuration changes. gitlab # [ 8.027055] systemd[1]: Starting resolvconf update... gitlab # [ 8.028000] systemd[1]: Finished Logrotate configuration check. gitlab # [ 8.029864] nsncd[565]: Aug 11 10:07:56.843 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.033023] systemd[1]: Finished Post-Boot Actions. gitlab # [ 8.035923] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.037670] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.038743] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.039809] systemd[1]: Starting User Login Management... gitlab # [ 8.041647] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 8.076981] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 8.081988] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 gitlab # [ 8.080749] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 8.081780] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 8.082763] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 8.086957] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 8.088252] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 8.089162] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 8.090054] systemd[1]: nscd.service: Consumed 25ms CPU time over 151ms wall clock time, 7.5M memory peak, 5.8M read from disk. gitlab # [ 8.094572] systemd-logind[599]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) gitlab # [ 8.097410] systemd-logind[599]: Watching system buttons on /dev/input/event0 (gpio-keys) gitlab # [ 8.135118] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 8.139580] systemd-logind[599]: New seat seat0. gitlab # [ 8.143201] systemd[1]: Finished resolvconf update. gitlab # [ 8.144382] systemd[1]: Reached target Preparation for Network. gitlab # [ 8.149003] systemd[1]: Starting DHCP Client... gitlab # [ 8.150011] nsncd[658]: Aug 11 10:07:57.000 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.156150] systemd[1]: Starting Address configuration of eth1... gitlab # [ 8.159380] systemd[1]: Starting Extra networking commands.... gitlab # [ 8.163732] systemd[1]: Started User Login Management. gitlab # [ 8.164617] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.165483] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.166396] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.168218] systemd[1]: Starting linger-users.service... gitlab # [ 8.192674] network-addresses-eth1-start[671]: adding address 192.168.1.1/24... done gitlab # [ 8.193908] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 8.194879] systemd[1]: Finished linger-users.service. gitlab # [ 8.200197] network-addresses-eth1-start[671]: adding address 2001:db8:1::1/64... done gitlab # [ 8.220848] systemd[1]: Finished Address configuration of eth1. gitlab # [ 8.272200] dhcpcd[692]: dhcpcd-10.3.2 starting gitlab # [ 8.277198] dhcpcd[732]: dev: loaded udev gitlab # [ 8.312630] systemd[1]: Finished Extra networking commands.. gitlab # [ 8.317597] systemd[1]: Reached target Network. gitlab # [ 8.329110] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 8.341348] systemd[1]: Starting Nginx Web Server... gitlab # [ 8.346074] systemd[1]: Starting PostgreSQL Server... gitlab # [ 8.358177] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 8.358576] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 8.388627] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 8.400603] systemd[1]: Starting Permit User Sessions... gitlab # [ 8.424348] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 8.431134] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 8.431700] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 8.435091] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 8.435438] cfg80211: failed to load regulatory.db gitlab # [ 8.443261] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 8.445650] systemd[1]: Starting Virtual Console Setup... gitlab # [ 8.449693] systemd[1]: Finished Permit User Sessions. gitlab # [ 8.466736] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 8.462920] dhcpcd[732]: eth0: waiting for carrier gitlab # [ 8.469133] dhcpcd[732]: libudev: received NULL device gitlab # [ 8.470072] systemd[1]: Started Getty on tty1. gitlab # [ 8.470771] dhcpcd[732]: libudev: received NULL device gitlab # [ 8.471588] dhcpcd[732]: eth0: carrier acquired gitlab # [ 8.472419] systemd[1]: Reached target Login Prompts. gitlab # [ 8.473295] systemd-logind[599]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 8.475003] dhcpcd[732]: DUID 00:01:00:01:32:0d:b0:fd:52:54:00:12:34:56 gitlab # [ 8.476000] dhcpcd[732]: eth0: IAID 00:12:34:56 gitlab # [ 8.476895] dhcpcd[732]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 8.558972] systemd-vconsole-setup[766]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 8.566564] systemd[1]: Finished Virtual Console Setup. gitlab # [ 8.586059] nginx-pre-start[790]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok gitlab # [ 8.589083] nginx-pre-start[790]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful gitlab # [ 8.595386] systemd[1]: Started Nginx Web Server. gitlab # [ 8.634435] postgresql-pre-start[792]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 8.635965] postgresql-pre-start[792]: This user must also own the server process. gitlab # [ 8.638559] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 8.643731] redis-server[789]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 8.645094] postgresql-pre-start[792]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 8.646374] postgresql-pre-start[792]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 8.647871] postgresql-pre-start[792]: The default text search configuration will be set to "english". gitlab # [ 8.649513] postgresql-pre-start[792]: Data page checksums are enabled. gitlab # [ 8.650620] postgresql-pre-start[792]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 8.652061] postgresql-pre-start[792]: creating subdirectories ... ok gitlab # [ 8.652999] postgresql-pre-start[792]: selecting dynamic shared memory implementation ... posix gitlab # [ 8.654338] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 8.655224] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started gitlab # [ 8.656933] redis-server[789]: Configuration loaded gitlab # [ 8.657881] redis[789]: monotonic clock: ARM CNTVCT @ 1000 ticks/us gitlab # [ 8.658991] redis[789]: Running mode=standalone, port=0. gitlab # [ 8.659942] redis[789]: Server initialized gitlab # [ 8.660788] redis[789]: Ready to accept connections unix gitlab # [ 8.661916] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 8.691979] postgresql-pre-start[792]: selecting default "max_connections" ... 100 gitlab # [ 8.753752] postgresql-pre-start[792]: selecting default "shared_buffers" ... 128MB gitlab # [ 9.038669] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 9.245775] gitlab-workhorse[816]: time="2026-08-11T10:07:58Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 9.247578] gitlab-workhorse[816]: time="2026-08-11T10:07:58Z" level=info msg="Using redis/go-redis" gitlab # [ 9.249249] gitlab-workhorse[816]: time="2026-08-11T10:07:58Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 9.257194] postgresql-pre-start[792]: selecting default time zone ... UTC gitlab # [ 9.260610] postgresql-pre-start[792]: creating configuration files ... ok gitlab # [ 9.507348] postgresql-pre-start[792]: running bootstrap script ... ok gitlab # [ 9.729745] dhcpcd[732]: eth0: soliciting a DHCP lease gitlab # [ 9.744760] dhcpcd[732]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 9.760394] dhcpcd[732]: eth0: probing address 10.0.2.15/24 gitlab # [ 10.230587] postgresql-pre-start[792]: performing post-bootstrap initialization ... ok gitlab # [ 10.446179] postgresql-pre-start[792]: syncing data to disk ... ok gitlab # [ 10.449301] postgresql-pre-start[792]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 10.453517] postgresql-pre-start[792]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 10.460202] postgresql-pre-start[792]: Success. You can now start the database server using: gitlab # [ 10.463897] postgresql-pre-start[792]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 10.609145] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 10.615171] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 10.618763] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 10.622405] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 10.630036] postgres[859]: [859] LOG: database system was shut down at 2026-08-11 10:07:59 GMT gitlab # [ 10.649873] postgres[850]: [850] LOG: database system is ready to accept connections gitlab # [ 10.654173] systemd[1]: Started PostgreSQL Server. gitlab # [ 10.663556] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 10.785929] dhcpcd[732]: eth0: soliciting an IPv6 router gitlab # [ 10.789830] dhcpcd[732]: eth0: Router Advertisement from fe80::2 gitlab # [ 10.792667] dhcpcd[732]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 10.795448] dhcpcd[732]: eth0: adding route to fec0::/64 gitlab # [ 10.797915] dhcpcd[732]: eth0: adding default route via fe80::2 gitlab # [ 11.112181] postgresql-setup-start[870]: CREATE DATABASE gitlab # [ 11.161015] postgresql-setup-start[879]: CREATE ROLE gitlab # [ 11.175456] postgresql-setup-start[882]: ALTER DATABASE gitlab # [ 11.233237] postgresql-setup-start[891]: CREATE ROLE gitlab # [ 11.237240] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 11.238738] systemd[1]: Reached target PostgreSQL. gitlab # [ 11.244213] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 11.348543] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[875]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 11.352819] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[875]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 11.388608] gitlab-postgresql-start[904]: CREATE DATABASE gitlab # [ 11.437162] systemd[1]: Finished gitlab-config.service. gitlab # [ 11.444922] systemd[1]: Started gitaly.service. gitlab # [ 11.446509] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 11.473058] gitlab-postgresql-start[919]: CREATE EXTENSION gitlab # [ 11.578357] gitlab-postgresql-start[925]: CREATE EXTENSION gitlab # [ 11.580793] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 12.188648] gitaly[922]: time="2026-08-11T10:08:01.041Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=922 gitlab # [ 12.208563] gitaly[922]: time="2026-08-11T10:08:01.042Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=922 gitlab # [ 12.213307] gitaly[922]: time="2026-08-11T10:08:01.042Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=922 gitlab # [ 12.219506] gitaly[922]: time="2026-08-11T10:08:01.042Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=922 gitlab # [ 12.224932] gitaly[922]: time="2026-08-11T10:08:01.042Z" level=info msg="Starting Gitaly" pid=922 version= gitlab # [ 12.405337] gitaly[922]: time="2026-08-11T10:08:01.259Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=216 pid=922 gitlab # [ 12.407172] gitaly[922]: time="2026-08-11T10:08:01.259Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=922 gitlab # [ 12.408755] gitaly[922]: time="2026-08-11T10:08:01.260Z" level=info msg="finished initializing command factory" duration_ms=0 pid=922 gitlab # [ 12.410293] gitaly[922]: time="2026-08-11T10:08:01.260Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-922/git-exec-2707909975.d/git pid=922 gitlab # [ 12.413371] gitaly[922]: time="2026-08-11T10:08:01.267Z" level=info msg="finished detecting git version" duration_ms=7 pid=922 gitlab # [ 12.414910] gitaly[922]: time="2026-08-11T10:08:01.267Z" level=info msg="using Git version" pid=922 version=2.53.g gitlab # [ 12.416782] gitaly[922]: time="2026-08-11T10:08:01.268Z" level=info msg="clearing disk cache object folder" pid=922 storage=default gitlab # [ 12.419007] gitaly[922]: time="2026-08-11T10:08:01.268Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3526718296 pid=922 storage=default gitlab # [ 12.421934] gitaly[922]: time="2026-08-11T10:08:01.268Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3526718296 pid=922 storage=default gitlab # [ 12.425493] gitaly[922]: time="2026-08-11T10:08:01.268Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=922 gitlab # [ 12.428446] gitaly[922]: time="2026-08-11T10:08:01.268Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=922 gitlab # [ 12.431594] gitaly[922]: time="2026-08-11T10:08:01.268Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3526718296 clear_duration_ms=0 pid=922 storage=default gitlab # [ 12.436320] gitaly[922]: time="2026-08-11T10:08:01.290Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=922 gitlab # [ 12.439319] gitaly[922]: time="2026-08-11T10:08:01.290Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=922 schema=unix gitlab # [ 12.442145] gitaly[922]: time="2026-08-11T10:08:01.290Z" level=info msg="finished tempdir cleaner walk" pid=922 storage=default time_ms=0 gitlab # [ 12.444487] gitaly[922]: time="2026-08-11T10:08:01.290Z" level=info msg="listening at address" address=/run/gitaly/gitaly-922/sock.d/intern pid=922 schema=unix gitlab # [ 12.447225] gitaly[922]: time="2026-08-11T10:08:01.290Z" level=info msg="counting repositories" pid=922 gitlab # [ 12.449120] gitaly[922]: time="2026-08-11T10:08:01.291Z" level=info msg="starting to count repositories" pid=922 storage_path=/var/gitlab/state/repositories gitlab # [ 12.451731] gitaly[922]: time="2026-08-11T10:08:01.291Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=922 storage_path=/var/gitlab/state/repositories gitlab # [ 12.455129] gitaly[922]: time="2026-08-11T10:08:01.291Z" level=info msg="completed counting all repositories" counting_duration=0 pid=922 gitlab # [ 12.458912] gitaly[922]: time="2026-08-11T10:08:01.293Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=922 gitlab # [ 12.461441] gitaly[922]: time="2026-08-11T10:08:01.293Z" level=info msg="Started Gitaly" duration_ms=251 pid=922 gitlab # [ 12.463592] gitaly[922]: time="2026-08-11T10:08:01.293Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=922 gitlab # [ 12.466220] gitaly[922]: time="2026-08-11T10:08:01.294Z" level=info msg="maintenance: daily scheduled" pid=922 scheduled="2026-08-11 12:00:00 +0000 UTC" gitlab # [ 12.911580] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[927]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.921993] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[927]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.931597] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[927]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 15.221185] dhcpcd[732]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 15.221486] dhcpcd[732]: eth0: adding route to 10.0.2.0/24 gitlab # [ 15.221693] dhcpcd[732]: eth0: adding default route via 10.0.2.2 gitlab # [ 15.413476] systemd[1]: Started DHCP Client. gitlab # [ 15.415505] systemd[1]: Reached target Network is Online. gitlab # [ 15.832465] gitaly[922]: time="2026-08-11T10:08:04.685Z" level=info msg="License database preloaded" duration_ms=3643 pid=922 gitlab # [ 58.039057] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[927]: W, [2026-08-11T10:08:46.891389 #927] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 59.302664] gitlab-workhorse[816]: time="2026-08-11T10:08:48Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 60.974922] postgres[1435]: [1435] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 60.975374] postgres[1435]: [1435] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 60.975507] postgres[1435]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 60.975633] postgres[1435]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 60.975755] postgres[1435]: attidentity AS identity, gitlab # [ 60.975873] postgres[1435]: attgenerated as attgenerated gitlab # [ 60.975994] postgres[1435]: FROM pg_attribute a gitlab # [ 60.996744] postgres[1435]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 61.000440] postgres[1435]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 61.003125] postgres[1435]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 61.007361] postgres[1435]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 61.010215] postgres[1435]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 61.012989] postgres[1435]: ORDER BY a.attnum gitlab # [ 61.014913] postgres[1435]: gitlab # [ 66.021147] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1486]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 66.021613] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1486]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 69.310346] gitlab-workhorse[816]: time="2026-08-11T10:08:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 79.319129] gitlab-workhorse[816]: time="2026-08-11T10:09:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 89.330732] gitlab-workhorse[816]: time="2026-08-11T10:09:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 92.404880] postgres[1580]: [1580] ERROR: relation "table_without_models" does not exist gitlab # [ 92.408358] postgres[1580]: [1580] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 99.334495] gitlab-workhorse[816]: time="2026-08-11T10:09:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 109.342772] gitlab-workhorse[816]: time="2026-08-11T10:09:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 119.353438] gitlab-workhorse[816]: time="2026-08-11T10:09:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 123.122512] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 123.136726] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 123.141928] systemd[1]: Starting gitlab.service... gitlab # [ 123.784160] bundle[1972]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 123.784737] bundle[1972]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 123.786025] bundle[1972]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 128.563637] sidekiq-cluster[1969]: {"severity":"INFO","time":"2026-08-11T10:09:57.377Z","message":"Starting cluster with 1 processes"} gitlab # [ 128.724684] bundle[1972]: {"timestamp":"2026-08-11T10:09:57.548Z","pid":1972,"message":"* Enabling systemd notification integration"} gitlab # [ 128.729668] bundle[1972]: {"timestamp":"2026-08-11T10:09:57.577Z","pid":1972,"message":"Puma starting in cluster mode..."} gitlab # [ 128.734472] bundle[1972]: {"timestamp":"2026-08-11T10:09:57.577Z","pid":1972,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 128.739498] bundle[1972]: {"timestamp":"2026-08-11T10:09:57.578Z","pid":1972,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 128.745456] bundle[1972]: {"timestamp":"2026-08-11T10:09:57.578Z","pid":1972,"message":"* Min threads: 0"} gitlab # [ 128.749389] bundle[1972]: {"timestamp":"2026-08-11T10:09:57.578Z","pid":1972,"message":"* Max threads: 4"} gitlab # [ 128.753308] bundle[1972]: {"timestamp":"2026-08-11T10:09:57.578Z","pid":1972,"message":"* Environment: production"} gitlab # [ 128.757512] bundle[1972]: {"timestamp":"2026-08-11T10:09:57.578Z","pid":1972,"message":"* Master PID: 1972"} gitlab # [ 128.761459] bundle[1972]: {"timestamp":"2026-08-11T10:09:57.578Z","pid":1972,"message":"* Workers: 2"} gitlab # [ 128.765322] bundle[1972]: {"timestamp":"2026-08-11T10:09:57.578Z","pid":1972,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 128.769864] bundle[1972]: {"timestamp":"2026-08-11T10:09:57.578Z","pid":1972,"message":"* Preloading application"} gitlab # [ 129.354313] gitlab-workhorse[816]: time="2026-08-11T10:09:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 139.367975] gitlab-workhorse[816]: time="2026-08-11T10:10:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 149.378386] gitlab-workhorse[816]: time="2026-08-11T10:10:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 159.379706] gitlab-workhorse[816]: time="2026-08-11T10:10:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 168.270670] bundle[1972]: W, [2026-08-11T10:10:37.123743 #1972] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 169.389801] gitlab-workhorse[816]: time="2026-08-11T10:10:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 171.432259] sidekiq-cluster[2021]: 2026-08-11T10:10:40.285Z pid=2021 tid=wnh INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2021, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>427986944} gitlab # [ 171.711626] sidekiq-cluster[2021]: W, [2026-08-11T10:10:40.565774 #2021] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 171.851987] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:40.706Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 175.206686] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.059Z","message":"GitLab reliable fetch activated!"} gitlab # [ 175.206876] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.059Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 175.261645] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.115Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 175.267649] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.119Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 175.273777] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.123Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 175.279363] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.126Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 175.285468] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.129Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 175.290310] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.132Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 175.294925] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.135Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 175.298902] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.137Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 175.302739] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.139Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 175.306388] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.141Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 175.310264] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.143Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 175.313740] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.146Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 175.316763] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.149Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 175.319816] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.151Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 175.322994] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.153Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 175.326033] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.156Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 175.328768] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.159Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 175.331297] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.162Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 175.334217] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.164Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 175.336844] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.167Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 175.339592] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.170Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 175.342598] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.172Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 175.345096] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.174Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 175.347488] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.177Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 175.350080] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.179Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 175.352399] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.182Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 175.354560] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.185Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 175.356854] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.188Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 175.359029] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.190Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 175.361372] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.193Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 175.363362] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.196Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 175.365726] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.198Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 175.367678] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.201Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 175.369957] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.204Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 175.371997] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.207Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 175.374214] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.209Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 175.376358] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.211Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 175.378355] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.214Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 175.380399] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.216Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 175.382374] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.218Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 175.384537] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.220Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 175.386614] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.222Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 175.388792] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.224Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 175.390799] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.227Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 175.393029] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.230Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 175.395304] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.232Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 175.397549] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.234Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 175.399641] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.237Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 175.401858] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.239Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 175.405078] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.242Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 175.407141] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.244Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 175.409306] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.247Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 175.411377] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.261Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 175.413847] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.265Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 175.415997] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.267Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 175.418088] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.270Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 175.420196] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.272Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 175.422384] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.275Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 175.424542] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.276Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 175.495176] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.349Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 175.500697] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.352Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 175.505996] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.354Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 175.511602] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.358Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 175.517441] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.361Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 175.523175] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.365Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 175.528361] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.367Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 175.532670] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.370Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 175.536888] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.372Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 175.541117] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.375Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 175.545231] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.377Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 175.548933] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.380Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 175.552410] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.382Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 175.555706] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.384Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 175.559317] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.387Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 175.562769] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.389Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 175.566054] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.391Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 175.569002] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.393Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 175.572090] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.396Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 175.574744] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.398Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 175.577422] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.400Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 175.580079] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.402Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 175.582731] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.405Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 175.585344] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.408Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 175.587696] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.411Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 175.590465] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.413Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 175.592932] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.416Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 175.595409] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.418Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 175.597911] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.421Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 175.600251] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.423Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 175.602514] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.426Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 175.605888] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.427Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 175.608148] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.429Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 175.610398] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.432Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 175.612853] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.434Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 175.614843] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.437Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 175.617332] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.440Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 175.619556] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.442Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 175.621937] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.446Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 175.624125] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.459Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 175.626309] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.462Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 175.628479] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.464Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 175.630643] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.468Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 175.632693] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.471Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 175.634822] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.474Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 175.637209] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.476Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 175.639514] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.478Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 175.641770] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.481Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 175.644004] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.485Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 175.646217] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:10:44.487Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 179.398241] gitlab-workhorse[816]: time="2026-08-11T10:10:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 189.406356] gitlab-workhorse[816]: time="2026-08-11T10:10:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 199.416490] gitlab-workhorse[816]: time="2026-08-11T10:11:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 209.426434] gitlab-workhorse[816]: time="2026-08-11T10:11:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 213.859055] postgres[2742]: [2742] ERROR: relation "table_without_models" does not exist gitlab # [ 213.859445] postgres[2742]: [2742] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 218.705251] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:27.558Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 218.713995] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:27.568Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 218.720156] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:27.568Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 218.721973] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:27.568Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 218.723947] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:27.571Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 219.082171] postgres[2781]: [2781] ERROR: relation "table_without_models" does not exist gitlab # [ 219.085873] postgres[2781]: [2781] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 219.446444] gitlab-workhorse[816]: time="2026-08-11T10:11:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 221.402099] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:30.255Z","message":"Cleaning working queues"} gitlab # [ 221.402610] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:30.256Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2f19ffabc6e3eb0793501d0a","created_at":"2026-08-11T10:09:51.324Z","trace_propagation_headers":{"sentry-trace":"05cae56e9f01425d92be0a9844c544a5-4c6bafaea0214f38","baggage":"sentry-trace_id=05cae56e9f01425d92be0a9844c544a5,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"56e9905b5f52d038f2d0c6cc4729c908","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:09:51.336Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2f19ffabc6e3eb0793501d0a: start","job_status":"start","queue_duration_s":98.919781,"scheduling_latency_s":98.919834} gitlab # [ 221.785031] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:30.638Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2f19ffabc6e3eb0793501d0a","created_at":"2026-08-11T10:09:51.324Z","trace_propagation_headers":{"sentry-trace":"05cae56e9f01425d92be0a9844c544a5-4c6bafaea0214f38","baggage":"sentry-trace_id=05cae56e9f01425d92be0a9844c544a5,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"56e9905b5f52d038f2d0c6cc4729c908","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:09:51.336Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2f19ffabc6e3eb0793501d0a: done: 0.381452 sec","job_status":"done","queue_duration_s":98.919781,"scheduling_latency_s":98.919834,"redis_calls":29,"redis_duration_s":0.012321,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007281,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0032,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00184,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.187026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19550700000000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.381452,"completed_at":"2026-08-11T10:11:30.637Z","load_balancing_strategy":"primary","db_duration_s":0.106862,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 227.054418] bundle[1972]: {"timestamp":"2026-08-11T10:11:35.907Z","pid":1972,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 227.054764] bundle[1972]: {"timestamp":"2026-08-11T10:11:35.907Z","pid":1972,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 227.054908] bundle[1972]: {"timestamp":"2026-08-11T10:11:35.907Z","pid":1972,"message":"! #\u003cThread:0x0000e174afe28a00 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 227.055124] bundle[1972]: {"timestamp":"2026-08-11T10:11:35.907Z","pid":1972,"message":"! #\u003cThread:0x0000e174af6ef450 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 227.055251] bundle[1972]: {"timestamp":"2026-08-11T10:11:35.907Z","pid":1972,"message":"Use Ctrl-C to stop"} gitlab # [ 227.055351] bundle[1972]: {"timestamp":"2026-08-11T10:11:35.908Z","pid":1972,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 227.811016] bundle[1972]: {"timestamp":"2026-08-11T10:11:36.665Z","pid":1972,"message":"- Worker 0 (PID: 2907) booted in 0.72s, phase: 0"} gitlab # [ 227.816639] bundle[1972]: {"timestamp":"2026-08-11T10:11:36.670Z","pid":1972,"message":"- Worker 1 (PID: 2911) booted in 0.71s, phase: 0"} gitlab # [ 227.822617] systemd[1]: Started gitlab.service. gitlab # [ 227.823460] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 227.830212] systemd[1]: Starting setup-gitlab.service... gitlab # [ 227.865040] setup-gitlab-start[2944]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 231.484303] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:11:40 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 3568 gitlab # [ 231.489458] setup-gitlab-start[2944]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 231.490082] setup-gitlab-start[2944]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 231.507461] runuser[2971]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 232.085046] setup-gitlab-start[2972]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 232.091628] setup-gitlab-start[2972]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 232.098633] setup-gitlab-start[2972]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 232.927381] setup-gitlab-start[2972]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 232.927729] setup-gitlab-start[2972]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 232.930231] setup-gitlab-start[2972]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 235.513066] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:44.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a0dc00cbca93bb148473a644","created_at":"2026-08-11T10:11:44.250Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f0c6a1117b955c41917f57568d66b25","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.359Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a0dc00cbca93bb148473a644: start","job_status":"start","queue_duration_s":0.004313,"scheduling_latency_s":0.004386} gitlab # [ 235.810982] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:44.664Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a0dc00cbca93bb148473a644","created_at":"2026-08-11T10:11:44.250Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f0c6a1117b955c41917f57568d66b25","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.359Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a0dc00cbca93bb148473a644: done: 0.300201 sec","job_status":"done","queue_duration_s":0.004313,"scheduling_latency_s":0.004386,"redis_calls":12,"redis_duration_s":0.034539,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003688,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.024125,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006726,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00203926,"exclusive_lock_hold_duration_s":0.08009224,"duration_s":0.300201,"completed_at":"2026-08-11T10:11:44.663Z","load_balancing_strategy":"primary","db_duration_s":0.100839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.909009] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:44.670Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ffb2d029151b530132a4ccee","created_at":"2026-08-11T10:11:44.415Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b242e2c2f1306b6f5703a9005bb4c06a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:11:44.444Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ffb2d029151b530132a4ccee: start","job_status":"start","queue_duration_s":0.225979,"scheduling_latency_s":0.226027} gitlab # [ 235.925352] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:44.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ffb2d029151b530132a4ccee","created_at":"2026-08-11T10:11:44.415Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b242e2c2f1306b6f5703a9005bb4c06a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:11:44.444Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ffb2d029151b530132a4ccee: done: 0.099105 sec","job_status":"done","queue_duration_s":0.225979,"scheduling_latency_s":0.226027,"redis_calls":10,"redis_duration_s":0.003123,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000615,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000682,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004849,"duration_s":0.099105,"completed_at":"2026-08-11T10:11:44.769Z","load_balancing_strategy":"primary","db_duration_s":0.010949,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.972604] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:44.771Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1ce86ccad4d8768ac6763df6","created_at":"2026-08-11T10:11:44.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57418a5c244b631b9db6642e98b09f46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.483Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1ce86ccad4d8768ac6763df6: start","job_status":"start","queue_duration_s":0.287781,"scheduling_latency_s":0.287804} gitlab # [ 235.988314] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:44.797Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 235.991470] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:44.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"1ce86ccad4d8768ac6763df6","created_at":"2026-08-11T10:11:44.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57418a5c244b631b9db6642e98b09f46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.483Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-1ce86ccad4d8768ac6763df6: done: 0.041967 sec","job_status":"done","queue_duration_s":0.287781,"scheduling_latency_s":0.287804,"redis_calls":10,"redis_duration_s":0.001914,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000351,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001197,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000366,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002825,"duration_s":0.041967,"completed_at":"2026-08-11T10:11:44.813Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.034884] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:44.814Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8c427250638845ea67d0ac2c","created_at":"2026-08-11T10:11:44.507Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88c13bc415010ec429710501f012ba95","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.536Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8c427250638845ea67d0ac2c: start","job_status":"start","queue_duration_s":0.278246,"scheduling_latency_s":0.278265} gitlab # [ 236.052512] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:44.905Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8c427250638845ea67d0ac2c","created_at":"2026-08-11T10:11:44.507Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88c13bc415010ec429710501f012ba95","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.536Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8c427250638845ea67d0ac2c: done: 0.091487 sec","job_status":"done","queue_duration_s":0.278246,"scheduling_latency_s":0.278265,"redis_calls":13,"redis_duration_s":0.002058,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000321,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000719,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0189405,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.091487,"completed_at":"2026-08-11T10:11:44.905Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036364,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 236.097845] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:44.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"74efe83831c143b6a74227ee","created_at":"2026-08-11T10:11:44.581Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"272b2d65e9b2c791abf7e879e8501f52","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.606Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-74efe83831c143b6a74227ee: start","job_status":"start","queue_duration_s":0.301784,"scheduling_latency_s":0.301816} gitlab # [ 236.552536] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:45.404Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"74efe83831c143b6a74227ee","created_at":"2026-08-11T10:11:44.581Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"272b2d65e9b2c791abf7e879e8501f52","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.606Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-74efe83831c143b6a74227ee: done: 0.496023 sec","job_status":"done","queue_duration_s":0.301784,"scheduling_latency_s":0.301816,"redis_calls":12,"redis_duration_s":0.014995999999999999,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000703,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006271,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008022,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.069,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.069,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.134901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00270078,"exclusive_lock_hold_duration_s":0.25793878,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.496023,"completed_at":"2026-08-11T10:11:45.404Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.082422,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.626638] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:45.409Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"ced8524a542ba3dcfcf72f17","created_at":"2026-08-11T10:11:44.648Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.667Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-ced8524a542ba3dcfcf72f17: start","job_status":"start","queue_duration_s":0.742216,"scheduling_latency_s":0.742268} gitlab # [ 236.671733] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:45.525Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"ced8524a542ba3dcfcf72f17","created_at":"2026-08-11T10:11:44.648Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.667Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-ced8524a542ba3dcfcf72f17: done: 0.115918 sec","job_status":"done","queue_duration_s":0.742216,"scheduling_latency_s":0.742268,"redis_calls":28,"redis_duration_s":0.010265999999999999,"redis_read_bytes":36,"redis_write_bytes":10593,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001919,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000613,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8305,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.005213,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002521,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045794,"duration_s":0.115918,"completed_at":"2026-08-11T10:11:45.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009382,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.746422] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:45.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c023bf6430a9c4e9a52fbdb5","created_at":"2026-08-11T10:11:44.681Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1dc9a162dcdf9e230ff834a4f65fffc9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:11:44.756Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c023bf6430a9c4e9a52fbdb5: start","job_status":"start","queue_duration_s":0.77145,"scheduling_latency_s":0.771472} gitlab # [ 236.764343] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:45.544Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 236.768202] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:45.553Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c023bf6430a9c4e9a52fbdb5","created_at":"2026-08-11T10:11:44.681Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1dc9a162dcdf9e230ff834a4f65fffc9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:11:44.756Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c023bf6430a9c4e9a52fbdb5: done: 0.02648 sec","job_status":"done","queue_duration_s":0.77145,"scheduling_latency_s":0.771472,"redis_calls":10,"redis_duration_s":0.003245,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001006,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001676,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000563,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004341,"duration_s":0.02648,"completed_at":"2026-08-11T10:11:45.553Z","load_balancing_strategy":"primary","db_duration_s":0.000941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.811361] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:45.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"2fa2ce304b8b17d3a92fdc8a","created_at":"2026-08-11T10:11:44.767Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3cb9dc771f9e149ba2bbb444dd63889","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.788Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-2fa2ce304b8b17d3a92fdc8a: start","job_status":"start","queue_duration_s":0.767558,"scheduling_latency_s":0.767581} gitlab # [ 237.256266] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"2fa2ce304b8b17d3a92fdc8a","created_at":"2026-08-11T10:11:44.767Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3cb9dc771f9e149ba2bbb444dd63889","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.788Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-2fa2ce304b8b17d3a92fdc8a: done: 0.554315 sec","job_status":"done","queue_duration_s":0.767558,"scheduling_latency_s":0.767581,"redis_calls":565,"redis_duration_s":0.14018,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000556,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001565,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.138059,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.475649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036828,"duration_s":0.554315,"completed_at":"2026-08-11T10:11:46.109Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00067,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.350936] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.112Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"2a6f6b78ca68ec445cb20a14","created_at":"2026-08-11T10:11:44.795Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.808Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-2a6f6b78ca68ec445cb20a14: start","job_status":"start","queue_duration_s":1.303263,"scheduling_latency_s":1.303286} gitlab # [ 237.377820] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.231Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"2a6f6b78ca68ec445cb20a14","created_at":"2026-08-11T10:11:44.795Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.808Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-2a6f6b78ca68ec445cb20a14: done: 0.119573 sec","job_status":"done","queue_duration_s":1.303263,"scheduling_latency_s":1.303286,"redis_calls":71,"redis_duration_s":0.019016,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002928,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001381,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013943,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000764,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035646,"duration_s":0.119573,"completed_at":"2026-08-11T10:11:46.231Z","load_balancing_strategy":"primary","db_duration_s":0.003546,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.439327] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.233Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"fabe16ddd06d0b7fc8437d3a","created_at":"2026-08-11T10:11:44.811Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b7ec1fd40d36f05564e216b0e125810","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:11:44.827Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-fabe16ddd06d0b7fc8437d3a: start","job_status":"start","queue_duration_s":1.405929,"scheduling_latency_s":1.405947} gitlab # [ 237.454591] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.246Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 237.458849] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.254Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"fabe16ddd06d0b7fc8437d3a","created_at":"2026-08-11T10:11:44.811Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b7ec1fd40d36f05564e216b0e125810","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:11:44.827Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-fabe16ddd06d0b7fc8437d3a: done: 0.020635 sec","job_status":"done","queue_duration_s":1.405929,"scheduling_latency_s":1.405947,"redis_calls":10,"redis_duration_s":0.0028,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000587,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001463,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00075,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036118,"duration_s":0.020635,"completed_at":"2026-08-11T10:11:46.254Z","load_balancing_strategy":"primary","db_duration_s":0.000674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.503042] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.255Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e36bb3dd286d8ae11f9bb0f8","created_at":"2026-08-11T10:11:44.851Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"960903bfb2e8ee809cb8f6fe05fa0e59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.872Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e36bb3dd286d8ae11f9bb0f8: start","job_status":"start","queue_duration_s":1.383102,"scheduling_latency_s":1.383118} gitlab # [ 237.518062] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.267Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 237.521447] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.275Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e36bb3dd286d8ae11f9bb0f8","created_at":"2026-08-11T10:11:44.851Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"960903bfb2e8ee809cb8f6fe05fa0e59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.872Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e36bb3dd286d8ae11f9bb0f8: done: 0.019517 sec","job_status":"done","queue_duration_s":1.383102,"scheduling_latency_s":1.383118,"redis_calls":10,"redis_duration_s":0.00256,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000486,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00152,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034788,"duration_s":0.019517,"completed_at":"2026-08-11T10:11:46.275Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000636,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.565535] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.277Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f763e1d59ae18bb953269c4a","created_at":"2026-08-11T10:11:44.896Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72e4372b1e98ef25dd01d421cf4dbe49","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.913Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f763e1d59ae18bb953269c4a: start","job_status":"start","queue_duration_s":1.363002,"scheduling_latency_s":1.363017} gitlab # [ 237.580393] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f763e1d59ae18bb953269c4a","created_at":"2026-08-11T10:11:44.896Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72e4372b1e98ef25dd01d421cf4dbe49","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.913Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f763e1d59ae18bb953269c4a: done: 0.022656 sec","job_status":"done","queue_duration_s":1.363002,"scheduling_latency_s":1.363017,"redis_calls":12,"redis_duration_s":0.003237,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001189,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036734,"duration_s":0.022656,"completed_at":"2026-08-11T10:11:46.299Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001123,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.623551] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f760ecd1e682f31d26a1963a","created_at":"2026-08-11T10:11:44.951Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04ccc4709731e0e66027f3d6de633ca5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.962Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f760ecd1e682f31d26a1963a: start","job_status":"start","queue_duration_s":1.339156,"scheduling_latency_s":1.339172} gitlab # [ 237.638400] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.313Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 237.642039] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.320Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f760ecd1e682f31d26a1963a","created_at":"2026-08-11T10:11:44.951Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04ccc4709731e0e66027f3d6de633ca5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:44.962Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f760ecd1e682f31d26a1963a: done: 0.019464 sec","job_status":"done","queue_duration_s":1.339156,"scheduling_latency_s":1.339172,"redis_calls":10,"redis_duration_s":0.0025,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001468,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000527,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034028,"duration_s":0.019464,"completed_at":"2026-08-11T10:11:46.320Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.684122] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.322Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ef87dc442ad26e4e0243734d","created_at":"2026-08-11T10:11:44.969Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b3e6dfd2abf823b8929f51474d3c0d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.001Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ef87dc442ad26e4e0243734d: start","job_status":"start","queue_duration_s":1.320539,"scheduling_latency_s":1.320553} gitlab # [ 237.740270] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.594Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ef87dc442ad26e4e0243734d","created_at":"2026-08-11T10:11:44.969Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b3e6dfd2abf823b8929f51474d3c0d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.001Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ef87dc442ad26e4e0243734d: done: 0.271943 sec","job_status":"done","queue_duration_s":1.320539,"scheduling_latency_s":1.320553,"redis_calls":14,"redis_duration_s":0.003757,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001013,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00145,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001294,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.06,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.058,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.193271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005618,"exclusive_lock_hold_duration_s":0.24878278,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.271943,"completed_at":"2026-08-11T10:11:46.594Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.791190] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d1feea25af4437eee13a2de7","created_at":"2026-08-11T10:11:45.034Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c99f15dccbb8a4336d049894b96800d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.052Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d1feea25af4437eee13a2de7: start","job_status":"start","queue_duration_s":1.543747,"scheduling_latency_s":1.543763} gitlab # [ 237.805818] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.646Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d1feea25af4437eee13a2de7","created_at":"2026-08-11T10:11:45.034Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c99f15dccbb8a4336d049894b96800d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.052Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d1feea25af4437eee13a2de7: done: 0.050147 sec","job_status":"done","queue_duration_s":1.543747,"scheduling_latency_s":1.543763,"redis_calls":12,"redis_duration_s":0.0034850000000000003,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000626,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001567,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001292,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062302,"exclusive_lock_hold_duration_s":0.02861456,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.050147,"completed_at":"2026-08-11T10:11:46.645Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019187,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.850635] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.647Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"afb3f5b3f27e824fece43147","created_at":"2026-08-11T10:11:45.109Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c23517952481172f63c21a3552d032de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.151Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-afb3f5b3f27e824fece43147: start","job_status":"start","queue_duration_s":1.496783,"scheduling_latency_s":1.4968} gitlab # [ 237.865541] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.668Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"afb3f5b3f27e824fece43147","created_at":"2026-08-11T10:11:45.109Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c23517952481172f63c21a3552d032de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.151Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-afb3f5b3f27e824fece43147: done: 0.020402 sec","job_status":"done","queue_duration_s":1.496783,"scheduling_latency_s":1.4968,"redis_calls":10,"redis_duration_s":0.0025700000000000002,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000582,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001502,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000486,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035734,"duration_s":0.020402,"completed_at":"2026-08-11T10:11:46.668Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000686,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.908611] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.669Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a1208a0b3891c7863eb74c40","created_at":"2026-08-11T10:11:45.159Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ec6f710c909971fdb877d6ced353553","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.172Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a1208a0b3891c7863eb74c40: start","job_status":"start","queue_duration_s":1.497627,"scheduling_latency_s":1.497643} gitlab # [ 237.922602] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.696Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a1208a0b3891c7863eb74c40","created_at":"2026-08-11T10:11:45.159Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ec6f710c909971fdb877d6ced353553","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.172Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a1208a0b3891c7863eb74c40: done: 0.026139 sec","job_status":"done","queue_duration_s":1.497627,"scheduling_latency_s":1.497643,"redis_calls":12,"redis_duration_s":0.003889,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00057,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001544,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058088,"exclusive_lock_hold_duration_s":0.00418374,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.026139,"completed_at":"2026-08-11T10:11:46.696Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002717,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.967436] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.697Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6843cb0b3702483521f2d350","created_at":"2026-08-11T10:11:45.203Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfe23f71cb710de1f8c01577584b72ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.211Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6843cb0b3702483521f2d350: start","job_status":"start","queue_duration_s":1.486229,"scheduling_latency_s":1.486245} gitlab # [ 237.982556] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.709Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 237.986552] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.717Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6843cb0b3702483521f2d350","created_at":"2026-08-11T10:11:45.203Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfe23f71cb710de1f8c01577584b72ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.211Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6843cb0b3702483521f2d350: done: 0.019708 sec","job_status":"done","queue_duration_s":1.486229,"scheduling_latency_s":1.486245,"redis_calls":10,"redis_duration_s":0.002267,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000579,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001254,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026852,"duration_s":0.019708,"completed_at":"2026-08-11T10:11:46.717Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000633,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.029274] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.718Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d706e9135feee15b57e30f3f","created_at":"2026-08-11T10:11:45.229Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1098e1d7bfbf9d651a0691d507b25693","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.236Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d706e9135feee15b57e30f3f: start","job_status":"start","queue_duration_s":1.482189,"scheduling_latency_s":1.482206} gitlab # [ 238.043560] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.880Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d706e9135feee15b57e30f3f","created_at":"2026-08-11T10:11:45.229Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1098e1d7bfbf9d651a0691d507b25693","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.236Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d706e9135feee15b57e30f3f: done: 0.161402 sec","job_status":"done","queue_duration_s":1.482189,"scheduling_latency_s":1.482206,"redis_calls":16,"redis_duration_s":0.002578,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001243,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000317,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025586,"duration_s":0.161402,"completed_at":"2026-08-11T10:11:46.880Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005722,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.086174] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.881Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f7b1564661d58f0dd5d6f352","created_at":"2026-08-11T10:11:45.243Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"192e422747b95cf3311f7dfe7a2306a7","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.256Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f7b1564661d58f0dd5d6f352: start","job_status":"start","queue_duration_s":1.624878,"scheduling_latency_s":1.624895} gitlab # [ 238.099962] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.932Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"f7b1564661d58f0dd5d6f352","created_at":"2026-08-11T10:11:45.243Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"192e422747b95cf3311f7dfe7a2306a7","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.256Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-f7b1564661d58f0dd5d6f352: done: 0.050782 sec","job_status":"done","queue_duration_s":1.624878,"scheduling_latency_s":1.624895,"redis_calls":10,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027764,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.050782,"completed_at":"2026-08-11T10:11:46.932Z","load_balancing_strategy":"primary","db_duration_s":0.02788,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.143172] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.933Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ae8196acb31a74917bb4eba6","created_at":"2026-08-11T10:11:45.277Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93e962e9e636d8c89c950f451b173e99","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.295Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ae8196acb31a74917bb4eba6: start","job_status":"start","queue_duration_s":1.638397,"scheduling_latency_s":1.638413} gitlab # [ 238.158387] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ae8196acb31a74917bb4eba6","created_at":"2026-08-11T10:11:45.277Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"93e962e9e636d8c89c950f451b173e99","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.295Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ae8196acb31a74917bb4eba6: done: 0.02577 sec","job_status":"done","queue_duration_s":1.638397,"scheduling_latency_s":1.638413,"redis_calls":10,"redis_duration_s":0.001496,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000322,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025494,"duration_s":0.02577,"completed_at":"2026-08-11T10:11:46.959Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.200792] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.960Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8d1178a8ce06af2c16217912","created_at":"2026-08-11T10:11:45.309Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ec8b9b8b634998e013c9e0b1dce4ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.327Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8d1178a8ce06af2c16217912: start","job_status":"start","queue_duration_s":1.633063,"scheduling_latency_s":1.63308} gitlab # [ 238.214383] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.997Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8d1178a8ce06af2c16217912","created_at":"2026-08-11T10:11:45.309Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ec8b9b8b634998e013c9e0b1dce4ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.327Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8d1178a8ce06af2c16217912: done: 0.036622 sec","job_status":"done","queue_duration_s":1.633063,"scheduling_latency_s":1.63308,"redis_calls":19,"redis_duration_s":0.002725,"redis_read_bytes":22,"redis_write_bytes":4781,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000633,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000193,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001436,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023706,"duration_s":0.036622,"completed_at":"2026-08-11T10:11:46.997Z","load_balancing_strategy":"primary","db_duration_s":0.00357,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.256849] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:46.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f3e440fc77929f1049629ffe","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f3e440fc77929f1049629ffe: start","job_status":"start","queue_duration_s":1.484975,"scheduling_latency_s":1.484992} gitlab # [ 238.270456] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f3e440fc77929f1049629ffe","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f3e440fc77929f1049629ffe: done: 0.050891 sec","job_status":"done","queue_duration_s":1.484975,"scheduling_latency_s":1.484992,"redis_calls":16,"redis_duration_s":0.002325,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000319,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00138,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002575,"duration_s":0.050891,"completed_at":"2026-08-11T10:11:47.049Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020895,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.311969] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d9f9efd26847a2e8e23979c7","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d9f9efd26847a2e8e23979c7: start","job_status":"start","queue_duration_s":1.537059,"scheduling_latency_s":1.537076} gitlab # [ 238.325518] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d9f9efd26847a2e8e23979c7","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d9f9efd26847a2e8e23979c7: done: 0.018484 sec","job_status":"done","queue_duration_s":1.537059,"scheduling_latency_s":1.537076,"redis_calls":13,"redis_duration_s":0.001823,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001218,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018484,"completed_at":"2026-08-11T10:11:47.068Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001846,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.365711] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1f48208dc6af847194cab2fe","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1f48208dc6af847194cab2fe: start","job_status":"start","queue_duration_s":1.556671,"scheduling_latency_s":1.556688} gitlab # [ 238.379098] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1f48208dc6af847194cab2fe","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1f48208dc6af847194cab2fe: done: 0.017125 sec","job_status":"done","queue_duration_s":1.556671,"scheduling_latency_s":1.556688,"redis_calls":13,"redis_duration_s":0.0016489999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017125,"completed_at":"2026-08-11T10:11:47.086Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001715,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.419501] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7b1145edaa463356532aa4ac","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7b1145edaa463356532aa4ac: start","job_status":"start","queue_duration_s":1.574937,"scheduling_latency_s":1.574954} gitlab # [ 238.432998] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7b1145edaa463356532aa4ac","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7b1145edaa463356532aa4ac: done: 0.016503 sec","job_status":"done","queue_duration_s":1.574937,"scheduling_latency_s":1.574954,"redis_calls":13,"redis_duration_s":0.0016589999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016503,"completed_at":"2026-08-11T10:11:47.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001557,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.472879] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9908f9f39f5c27d59e041abf","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9908f9f39f5c27d59e041abf: start","job_status":"start","queue_duration_s":1.592543,"scheduling_latency_s":1.592558} gitlab # [ 238.486795] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"9908f9f39f5c27d59e041abf","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-9908f9f39f5c27d59e041abf: done: 0.016559 sec","job_status":"done","queue_duration_s":1.592543,"scheduling_latency_s":1.592558,"redis_calls":13,"redis_duration_s":0.001683,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016559,"completed_at":"2026-08-11T10:11:47.122Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001581,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.527254] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"be8f99f32d57b1f36febfb5a","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-be8f99f32d57b1f36febfb5a: start","job_status":"start","queue_duration_s":1.610959,"scheduling_latency_s":1.610975} gitlab # [ 238.540977] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"be8f99f32d57b1f36febfb5a","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-be8f99f32d57b1f36febfb5a: done: 0.016341 sec","job_status":"done","queue_duration_s":1.610959,"scheduling_latency_s":1.610975,"redis_calls":13,"redis_duration_s":0.0016029999999999998,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016341,"completed_at":"2026-08-11T10:11:47.140Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00153,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.582859] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f6ec1997da32c322663de857","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f6ec1997da32c322663de857: start","job_status":"start","queue_duration_s":1.628413,"scheduling_latency_s":1.628429} gitlab # [ 238.596739] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"f6ec1997da32c322663de857","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-f6ec1997da32c322663de857: done: 0.016091 sec","job_status":"done","queue_duration_s":1.628413,"scheduling_latency_s":1.628429,"redis_calls":13,"redis_duration_s":0.001763,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016091,"completed_at":"2026-08-11T10:11:47.157Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001082,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.637325] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"08067ce2cd175605a8566e2f","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-08067ce2cd175605a8566e2f: start","job_status":"start","queue_duration_s":1.645599,"scheduling_latency_s":1.645615} gitlab # [ 238.650674] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"08067ce2cd175605a8566e2f","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-08067ce2cd175605a8566e2f: done: 0.015832 sec","job_status":"done","queue_duration_s":1.645599,"scheduling_latency_s":1.645615,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015832,"completed_at":"2026-08-11T10:11:47.174Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00102,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.690871] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d7acf74c3ef0d54389abe580","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d7acf74c3ef0d54389abe580: start","job_status":"start","queue_duration_s":1.662546,"scheduling_latency_s":1.662561} gitlab # [ 238.704287] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d7acf74c3ef0d54389abe580","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d7acf74c3ef0d54389abe580: done: 0.015899 sec","job_status":"done","queue_duration_s":1.662546,"scheduling_latency_s":1.662561,"redis_calls":13,"redis_duration_s":0.001689,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015899,"completed_at":"2026-08-11T10:11:47.191Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.743716] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"ff39d55ad7342c9fe9b446c9","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-ff39d55ad7342c9fe9b446c9: start","job_status":"start","queue_duration_s":1.6795,"scheduling_latency_s":1.679515} gitlab # [ 238.757358] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"ff39d55ad7342c9fe9b446c9","created_at":"2026-08-11T10:11:45.467Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-59d5e8dc07314b00","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"e181cb06ac6910665cafe69b34eb4a02","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:45.513Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-ff39d55ad7342c9fe9b446c9: done: 0.015422 sec","job_status":"done","queue_duration_s":1.6795,"scheduling_latency_s":1.679515,"redis_calls":13,"redis_duration_s":0.0015509999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015422,"completed_at":"2026-08-11T10:11:47.208Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.797947] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4cad2e59e5b587c219ab45d","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4cad2e59e5b587c219ab45d: start","job_status":"start","queue_duration_s":0.988591,"scheduling_latency_s":0.988607} gitlab # [ 238.810563] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4cad2e59e5b587c219ab45d","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4cad2e59e5b587c219ab45d: done: 0.021794 sec","job_status":"done","queue_duration_s":0.988591,"scheduling_latency_s":0.988607,"redis_calls":16,"redis_duration_s":0.00214,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001226,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002583,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021794,"completed_at":"2026-08-11T10:11:47.231Z","load_balancing_strategy":"primary","db_duration_s":0.000628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.851628] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11a4031c1ad8a91d146041c6","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11a4031c1ad8a91d146041c6: start","job_status":"start","queue_duration_s":1.011463,"scheduling_latency_s":1.011479} gitlab # [ 238.864376] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11a4031c1ad8a91d146041c6","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11a4031c1ad8a91d146041c6: done: 0.014684 sec","job_status":"done","queue_duration_s":1.011463,"scheduling_latency_s":1.011479,"redis_calls":13,"redis_duration_s":0.002208,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001665,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014684,"completed_at":"2026-08-11T10:11:47.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.903682] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81bfb2936e2a22e9d0951416","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81bfb2936e2a22e9d0951416: start","job_status":"start","queue_duration_s":1.0272,"scheduling_latency_s":1.027215} gitlab # [ 238.916304] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81bfb2936e2a22e9d0951416","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81bfb2936e2a22e9d0951416: done: 0.015215 sec","job_status":"done","queue_duration_s":1.0272,"scheduling_latency_s":1.027215,"redis_calls":13,"redis_duration_s":0.001761,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001171,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015215,"completed_at":"2026-08-11T10:11:47.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.955246] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3825a591756805edaf3a5121","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3825a591756805edaf3a5121: start","job_status":"start","queue_duration_s":1.043541,"scheduling_latency_s":1.043557} gitlab # [ 238.969048] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3825a591756805edaf3a5121","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3825a591756805edaf3a5121: done: 0.014968 sec","job_status":"done","queue_duration_s":1.043541,"scheduling_latency_s":1.043557,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014968,"completed_at":"2026-08-11T10:11:47.279Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.009022] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8146d5cb1cfa6d7b263ebfe9","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8146d5cb1cfa6d7b263ebfe9: start","job_status":"start","queue_duration_s":1.061382,"scheduling_latency_s":1.061399} gitlab # [ 239.021588] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8146d5cb1cfa6d7b263ebfe9","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8146d5cb1cfa6d7b263ebfe9: done: 0.015725 sec","job_status":"done","queue_duration_s":1.061382,"scheduling_latency_s":1.061399,"redis_calls":13,"redis_duration_s":0.0016150000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015725,"completed_at":"2026-08-11T10:11:47.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.062221] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c36861129ea9c3b07a7677bc","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c36861129ea9c3b07a7677bc: start","job_status":"start","queue_duration_s":1.078274,"scheduling_latency_s":1.078291} gitlab # [ 239.074862] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c36861129ea9c3b07a7677bc","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c36861129ea9c3b07a7677bc: done: 0.016151 sec","job_status":"done","queue_duration_s":1.078274,"scheduling_latency_s":1.078291,"redis_calls":13,"redis_duration_s":0.001588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016151,"completed_at":"2026-08-11T10:11:47.315Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.115357] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ed1ac96bf802038330cf71a","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ed1ac96bf802038330cf71a: start","job_status":"start","queue_duration_s":1.095533,"scheduling_latency_s":1.095548} gitlab # [ 239.128238] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ed1ac96bf802038330cf71a","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ed1ac96bf802038330cf71a: done: 0.015568 sec","job_status":"done","queue_duration_s":1.095533,"scheduling_latency_s":1.095548,"redis_calls":13,"redis_duration_s":0.001543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015568,"completed_at":"2026-08-11T10:11:47.332Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.167873] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04c8231b41058f150f7cecdc","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04c8231b41058f150f7cecdc: start","job_status":"start","queue_duration_s":1.112164,"scheduling_latency_s":1.112179} gitlab # [ 239.181684] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04c8231b41058f150f7cecdc","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04c8231b41058f150f7cecdc: done: 0.01506 sec","job_status":"done","queue_duration_s":1.112164,"scheduling_latency_s":1.112179,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01506,"completed_at":"2026-08-11T10:11:47.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.220634] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b573f507104fa4acc87b7f43","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b573f507104fa4acc87b7f43: start","job_status":"start","queue_duration_s":1.129546,"scheduling_latency_s":1.129562} gitlab # [ 239.232921] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b573f507104fa4acc87b7f43","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b573f507104fa4acc87b7f43: done: 0.018103 sec","job_status":"done","queue_duration_s":1.129546,"scheduling_latency_s":1.129562,"redis_calls":13,"redis_duration_s":0.001641,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018103,"completed_at":"2026-08-11T10:11:47.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.271866] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05d6ad77fafc21eeba8335c5","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05d6ad77fafc21eeba8335c5: start","job_status":"start","queue_duration_s":1.148707,"scheduling_latency_s":1.148722} gitlab # [ 239.284086] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05d6ad77fafc21eeba8335c5","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05d6ad77fafc21eeba8335c5: done: 0.014893 sec","job_status":"done","queue_duration_s":1.148707,"scheduling_latency_s":1.148722,"redis_calls":13,"redis_duration_s":0.001547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014893,"completed_at":"2026-08-11T10:11:47.384Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.322983] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01bbb892d75284654bea8d9e","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01bbb892d75284654bea8d9e: start","job_status":"start","queue_duration_s":1.164674,"scheduling_latency_s":1.164691} gitlab # [ 239.335541] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01bbb892d75284654bea8d9e","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01bbb892d75284654bea8d9e: done: 0.014377 sec","job_status":"done","queue_duration_s":1.164674,"scheduling_latency_s":1.164691,"redis_calls":13,"redis_duration_s":0.001542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014377,"completed_at":"2026-08-11T10:11:47.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.375283] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c92be0783f09baf7d3d0bc34","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c92be0783f09baf7d3d0bc34: start","job_status":"start","queue_duration_s":1.180668,"scheduling_latency_s":1.180685} gitlab # [ 239.387892] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c92be0783f09baf7d3d0bc34","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c92be0783f09baf7d3d0bc34: done: 0.014697 sec","job_status":"done","queue_duration_s":1.180668,"scheduling_latency_s":1.180685,"redis_calls":13,"redis_duration_s":0.00191,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014697,"completed_at":"2026-08-11T10:11:47.416Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.428043] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff87f950d16dcc7d5e59d13b","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff87f950d16dcc7d5e59d13b: start","job_status":"start","queue_duration_s":1.196553,"scheduling_latency_s":1.19657} gitlab # [ 239.440706] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff87f950d16dcc7d5e59d13b","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff87f950d16dcc7d5e59d13b: done: 0.014628 sec","job_status":"done","queue_duration_s":1.196553,"scheduling_latency_s":1.19657,"redis_calls":13,"redis_duration_s":0.0019450000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001399,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014628,"completed_at":"2026-08-11T10:11:47.432Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.480906] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c5fd637d148571f912dbb2e","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c5fd637d148571f912dbb2e: start","job_status":"start","queue_duration_s":1.212279,"scheduling_latency_s":1.212296} gitlab # [ 239.493719] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c5fd637d148571f912dbb2e","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c5fd637d148571f912dbb2e: done: 0.014471 sec","job_status":"done","queue_duration_s":1.212279,"scheduling_latency_s":1.212296,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014471,"completed_at":"2026-08-11T10:11:47.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.532988] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4eeaffa48906a7b3bd7e6a0b","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4eeaffa48906a7b3bd7e6a0b: start","job_status":"start","queue_duration_s":1.227888,"scheduling_latency_s":1.227903} gitlab # [ 239.545332] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4eeaffa48906a7b3bd7e6a0b","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4eeaffa48906a7b3bd7e6a0b: done: 0.014492 sec","job_status":"done","queue_duration_s":1.227888,"scheduling_latency_s":1.227903,"redis_calls":13,"redis_duration_s":0.00167,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000725,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014492,"completed_at":"2026-08-11T10:11:47.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.585900] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5825a1290db321eaccacc5c","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5825a1290db321eaccacc5c: start","job_status":"start","queue_duration_s":1.2436,"scheduling_latency_s":1.243615} gitlab # [ 239.598697] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5825a1290db321eaccacc5c","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5825a1290db321eaccacc5c: done: 0.014435 sec","job_status":"done","queue_duration_s":1.2436,"scheduling_latency_s":1.243615,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014435,"completed_at":"2026-08-11T10:11:47.479Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.638831] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0327307d913f75cdc751647d","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0327307d913f75cdc751647d: start","job_status":"start","queue_duration_s":1.259135,"scheduling_latency_s":1.25915} gitlab # [ 239.651493] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0327307d913f75cdc751647d","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0327307d913f75cdc751647d: done: 0.014497 sec","job_status":"done","queue_duration_s":1.259135,"scheduling_latency_s":1.25915,"redis_calls":13,"redis_duration_s":0.001663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014497,"completed_at":"2026-08-11T10:11:47.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.691250] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ea5068e3051436b64b9f217","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ea5068e3051436b64b9f217: start","job_status":"start","queue_duration_s":1.274741,"scheduling_latency_s":1.274756} gitlab # [ 239.703951] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ea5068e3051436b64b9f217","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ea5068e3051436b64b9f217: done: 0.014457 sec","job_status":"done","queue_duration_s":1.274741,"scheduling_latency_s":1.274756,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014457,"completed_at":"2026-08-11T10:11:47.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.744173] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"deea0ef60755bc4f84fffd44","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-deea0ef60755bc4f84fffd44: start","job_status":"start","queue_duration_s":1.290315,"scheduling_latency_s":1.290331} gitlab # [ 239.756523] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"deea0ef60755bc4f84fffd44","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-deea0ef60755bc4f84fffd44: done: 0.014418 sec","job_status":"done","queue_duration_s":1.290315,"scheduling_latency_s":1.290331,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014418,"completed_at":"2026-08-11T10:11:47.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.797026] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6370ec0ccc7a34bdfcca76ad","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6370ec0ccc7a34bdfcca76ad: start","job_status":"start","queue_duration_s":1.305936,"scheduling_latency_s":1.305953} gitlab # [ 239.809658] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6370ec0ccc7a34bdfcca76ad","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6370ec0ccc7a34bdfcca76ad: done: 0.014487 sec","job_status":"done","queue_duration_s":1.305936,"scheduling_latency_s":1.305953,"redis_calls":13,"redis_duration_s":0.0015469999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014487,"completed_at":"2026-08-11T10:11:47.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.849104] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7207fb9e77e35da9c8ab283","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7207fb9e77e35da9c8ab283: start","job_status":"start","queue_duration_s":1.321609,"scheduling_latency_s":1.321626} gitlab # [ 239.861416] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7207fb9e77e35da9c8ab283","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7207fb9e77e35da9c8ab283: done: 0.014449 sec","job_status":"done","queue_duration_s":1.321609,"scheduling_latency_s":1.321626,"redis_calls":13,"redis_duration_s":0.001733,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014449,"completed_at":"2026-08-11T10:11:47.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.900364] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33f0f35095428d9d4da587c7","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33f0f35095428d9d4da587c7: start","job_status":"start","queue_duration_s":1.337217,"scheduling_latency_s":1.337233} gitlab # [ 239.912261] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33f0f35095428d9d4da587c7","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33f0f35095428d9d4da587c7: done: 0.014339 sec","job_status":"done","queue_duration_s":1.337217,"scheduling_latency_s":1.337233,"redis_calls":13,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014339,"completed_at":"2026-08-11T10:11:47.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.951518] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f1728240101ca868cfa9690","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f1728240101ca868cfa9690: start","job_status":"start","queue_duration_s":1.352905,"scheduling_latency_s":1.352921} gitlab # [ 239.964208] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f1728240101ca868cfa9690","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f1728240101ca868cfa9690: done: 0.014571 sec","job_status":"done","queue_duration_s":1.352905,"scheduling_latency_s":1.352921,"redis_calls":13,"redis_duration_s":0.001633,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014571,"completed_at":"2026-08-11T10:11:47.588Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.005385] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b7d11e2b24f361cc2c7fd27","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b7d11e2b24f361cc2c7fd27: start","job_status":"start","queue_duration_s":1.368585,"scheduling_latency_s":1.368601} gitlab # [ 240.043187] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b7d11e2b24f361cc2c7fd27","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b7d11e2b24f361cc2c7fd27: done: 0.014304 sec","job_status":"done","queue_duration_s":1.368585,"scheduling_latency_s":1.368601,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014304,"completed_at":"2026-08-11T10:11:47.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.118031] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0555f72f7e1d9041739b61b","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0555f72f7e1d9041739b61b: start","job_status":"start","queue_duration_s":1.384037,"scheduling_latency_s":1.384052} gitlab # [ 240.137439] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0555f72f7e1d9041739b61b","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0555f72f7e1d9041739b61b: done: 0.014549 sec","job_status":"done","queue_duration_s":1.384037,"scheduling_latency_s":1.384052,"redis_calls":13,"redis_duration_s":0.00158,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014549,"completed_at":"2026-08-11T10:11:47.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.188135] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c066ae7a4c7978c6702dbfe","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c066ae7a4c7978c6702dbfe: start","job_status":"start","queue_duration_s":1.399754,"scheduling_latency_s":1.39977} gitlab # [ 240.202853] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c066ae7a4c7978c6702dbfe","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c066ae7a4c7978c6702dbfe: done: 0.014328 sec","job_status":"done","queue_duration_s":1.399754,"scheduling_latency_s":1.39977,"redis_calls":13,"redis_duration_s":0.0014880000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014328,"completed_at":"2026-08-11T10:11:47.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.244723] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ca97c1f9b25913b59c784c9","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ca97c1f9b25913b59c784c9: start","job_status":"start","queue_duration_s":1.415454,"scheduling_latency_s":1.41547} gitlab # [ 240.256977] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ca97c1f9b25913b59c784c9","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ca97c1f9b25913b59c784c9: done: 0.014349 sec","job_status":"done","queue_duration_s":1.415454,"scheduling_latency_s":1.41547,"redis_calls":13,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014349,"completed_at":"2026-08-11T10:11:47.651Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.295525] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27a681b79fdfc38881e85ee6","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27a681b79fdfc38881e85ee6: start","job_status":"start","queue_duration_s":1.431082,"scheduling_latency_s":1.431099} gitlab # [ 240.308183] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27a681b79fdfc38881e85ee6","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27a681b79fdfc38881e85ee6: done: 0.017096 sec","job_status":"done","queue_duration_s":1.431082,"scheduling_latency_s":1.431099,"redis_calls":13,"redis_duration_s":0.0035429999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00291,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017096,"completed_at":"2026-08-11T10:11:47.669Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.346903] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6743f2236c099756c4d73505","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6743f2236c099756c4d73505: start","job_status":"start","queue_duration_s":1.44938,"scheduling_latency_s":1.449396} gitlab # [ 240.359236] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6743f2236c099756c4d73505","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6743f2236c099756c4d73505: done: 0.014291 sec","job_status":"done","queue_duration_s":1.44938,"scheduling_latency_s":1.449396,"redis_calls":13,"redis_duration_s":0.0015370000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014291,"completed_at":"2026-08-11T10:11:47.685Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.399427] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b43415dbc55bc80b1469be7","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b43415dbc55bc80b1469be7: start","job_status":"start","queue_duration_s":1.464806,"scheduling_latency_s":1.464821} gitlab # [ 240.412336] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b43415dbc55bc80b1469be7","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b43415dbc55bc80b1469be7: done: 0.015178 sec","job_status":"done","queue_duration_s":1.464806,"scheduling_latency_s":1.464821,"redis_calls":13,"redis_duration_s":0.0016650000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015178,"completed_at":"2026-08-11T10:11:47.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.451137] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"946124376398bff2659d883a","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-946124376398bff2659d883a: start","job_status":"start","queue_duration_s":1.481278,"scheduling_latency_s":1.481295} gitlab # [ 240.463522] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"946124376398bff2659d883a","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-946124376398bff2659d883a: done: 0.014584 sec","job_status":"done","queue_duration_s":1.481278,"scheduling_latency_s":1.481295,"redis_calls":13,"redis_duration_s":0.00154,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014584,"completed_at":"2026-08-11T10:11:47.717Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.502632] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14bf36509ecc8d40b14538c8","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14bf36509ecc8d40b14538c8: start","job_status":"start","queue_duration_s":1.496987,"scheduling_latency_s":1.497003} gitlab # [ 240.515089] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14bf36509ecc8d40b14538c8","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14bf36509ecc8d40b14538c8: done: 0.01429 sec","job_status":"done","queue_duration_s":1.496987,"scheduling_latency_s":1.497003,"redis_calls":13,"redis_duration_s":0.001546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01429,"completed_at":"2026-08-11T10:11:47.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.554094] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43a482a338931baa684d36ab","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43a482a338931baa684d36ab: start","job_status":"start","queue_duration_s":1.512373,"scheduling_latency_s":1.512389} gitlab # [ 240.566700] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43a482a338931baa684d36ab","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43a482a338931baa684d36ab: done: 0.016506 sec","job_status":"done","queue_duration_s":1.512373,"scheduling_latency_s":1.512389,"redis_calls":13,"redis_duration_s":0.001623,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016506,"completed_at":"2026-08-11T10:11:47.750Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.606858] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71c2755195c16d6485e91e94","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71c2755195c16d6485e91e94: start","job_status":"start","queue_duration_s":1.530531,"scheduling_latency_s":1.530548} gitlab # [ 240.619598] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71c2755195c16d6485e91e94","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71c2755195c16d6485e91e94: done: 0.015747 sec","job_status":"done","queue_duration_s":1.530531,"scheduling_latency_s":1.530548,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015747,"completed_at":"2026-08-11T10:11:47.767Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.660765] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd7dbf2dc8cc9b6f6caefaa7","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd7dbf2dc8cc9b6f6caefaa7: start","job_status":"start","queue_duration_s":1.547757,"scheduling_latency_s":1.547776} gitlab # [ 240.673463] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd7dbf2dc8cc9b6f6caefaa7","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd7dbf2dc8cc9b6f6caefaa7: done: 0.01662 sec","job_status":"done","queue_duration_s":1.547757,"scheduling_latency_s":1.547776,"redis_calls":13,"redis_duration_s":0.0016610000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01662,"completed_at":"2026-08-11T10:11:47.785Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.713722] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e542f4786f2df5902be62be6","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e542f4786f2df5902be62be6: start","job_status":"start","queue_duration_s":1.565161,"scheduling_latency_s":1.565177} gitlab # [ 240.726388] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e542f4786f2df5902be62be6","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e542f4786f2df5902be62be6: done: 0.016024 sec","job_status":"done","queue_duration_s":1.565161,"scheduling_latency_s":1.565177,"redis_calls":13,"redis_duration_s":0.001598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016024,"completed_at":"2026-08-11T10:11:47.802Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.766314] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.803Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3034b791b79095d7a628517e","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3034b791b79095d7a628517e: start","job_status":"start","queue_duration_s":1.582363,"scheduling_latency_s":1.582379} gitlab # [ 240.779059] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3034b791b79095d7a628517e","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3034b791b79095d7a628517e: done: 0.015984 sec","job_status":"done","queue_duration_s":1.582363,"scheduling_latency_s":1.582379,"redis_calls":13,"redis_duration_s":0.0020280000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001464,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015984,"completed_at":"2026-08-11T10:11:47.819Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.820328] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7328e91799e35f1f784c338b","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7328e91799e35f1f784c338b: start","job_status":"start","queue_duration_s":1.599436,"scheduling_latency_s":1.599452} gitlab # [ 240.832829] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7328e91799e35f1f784c338b","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7328e91799e35f1f784c338b: done: 0.016254 sec","job_status":"done","queue_duration_s":1.599436,"scheduling_latency_s":1.599452,"redis_calls":13,"redis_duration_s":0.001625,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016254,"completed_at":"2026-08-11T10:11:47.837Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.873079] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40af7ac36790c72eda3dee6d","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40af7ac36790c72eda3dee6d: start","job_status":"start","queue_duration_s":1.616787,"scheduling_latency_s":1.616802} gitlab # [ 240.885461] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40af7ac36790c72eda3dee6d","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40af7ac36790c72eda3dee6d: done: 0.015843 sec","job_status":"done","queue_duration_s":1.616787,"scheduling_latency_s":1.616802,"redis_calls":13,"redis_duration_s":0.001592,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015843,"completed_at":"2026-08-11T10:11:47.853Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.924645] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d62b04c410aac3effd4bd7b","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d62b04c410aac3effd4bd7b: start","job_status":"start","queue_duration_s":1.633756,"scheduling_latency_s":1.633771} gitlab # [ 240.937141] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d62b04c410aac3effd4bd7b","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d62b04c410aac3effd4bd7b: done: 0.0159 sec","job_status":"done","queue_duration_s":1.633756,"scheduling_latency_s":1.633771,"redis_calls":13,"redis_duration_s":0.001612,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0159,"completed_at":"2026-08-11T10:11:47.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.976449] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb0907730c0989f6247a835c","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb0907730c0989f6247a835c: start","job_status":"start","queue_duration_s":1.651284,"scheduling_latency_s":1.6513} gitlab # [ 240.989071] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb0907730c0989f6247a835c","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb0907730c0989f6247a835c: done: 0.015689 sec","job_status":"done","queue_duration_s":1.651284,"scheduling_latency_s":1.6513,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015689,"completed_at":"2026-08-11T10:11:47.888Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.029887] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67e029608a9bc0c987362af5","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67e029608a9bc0c987362af5: start","job_status":"start","queue_duration_s":1.668545,"scheduling_latency_s":1.668562} gitlab # [ 241.042211] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67e029608a9bc0c987362af5","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67e029608a9bc0c987362af5: done: 0.016452 sec","job_status":"done","queue_duration_s":1.668545,"scheduling_latency_s":1.668562,"redis_calls":13,"redis_duration_s":0.001702,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016452,"completed_at":"2026-08-11T10:11:47.906Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.082360] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96ef06c5fb6d493bc2f36761","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96ef06c5fb6d493bc2f36761: start","job_status":"start","queue_duration_s":1.686719,"scheduling_latency_s":1.686736} gitlab # [ 241.095149] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96ef06c5fb6d493bc2f36761","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96ef06c5fb6d493bc2f36761: done: 0.016465 sec","job_status":"done","queue_duration_s":1.686719,"scheduling_latency_s":1.686736,"redis_calls":13,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016465,"completed_at":"2026-08-11T10:11:47.924Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.134185] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f484ee21ac8343df8a57d1f2","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f484ee21ac8343df8a57d1f2: start","job_status":"start","queue_duration_s":1.705133,"scheduling_latency_s":1.705151} gitlab # [ 241.146889] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f484ee21ac8343df8a57d1f2","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f484ee21ac8343df8a57d1f2: done: 0.015368 sec","job_status":"done","queue_duration_s":1.705133,"scheduling_latency_s":1.705151,"redis_calls":13,"redis_duration_s":0.001573,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015368,"completed_at":"2026-08-11T10:11:47.941Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.186041] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be48bf932065627378782eb0","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be48bf932065627378782eb0: start","job_status":"start","queue_duration_s":1.72206,"scheduling_latency_s":1.722078} gitlab # [ 241.198441] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be48bf932065627378782eb0","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be48bf932065627378782eb0: done: 0.015666 sec","job_status":"done","queue_duration_s":1.72206,"scheduling_latency_s":1.722078,"redis_calls":13,"redis_duration_s":0.0016920000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015666,"completed_at":"2026-08-11T10:11:47.959Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.239420] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"085d4a01c0ba1397bb350755","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-085d4a01c0ba1397bb350755: start","job_status":"start","queue_duration_s":1.738855,"scheduling_latency_s":1.738871} gitlab # [ 241.252711] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"085d4a01c0ba1397bb350755","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-085d4a01c0ba1397bb350755: done: 0.015854 sec","job_status":"done","queue_duration_s":1.738855,"scheduling_latency_s":1.738871,"redis_calls":13,"redis_duration_s":0.001936,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001392,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015854,"completed_at":"2026-08-11T10:11:47.976Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.293111] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d70bd2ffa0c0ec1b72e26a68","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d70bd2ffa0c0ec1b72e26a68: start","job_status":"start","queue_duration_s":1.755847,"scheduling_latency_s":1.755864} gitlab # [ 241.305585] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d70bd2ffa0c0ec1b72e26a68","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d70bd2ffa0c0ec1b72e26a68: done: 0.01656 sec","job_status":"done","queue_duration_s":1.755847,"scheduling_latency_s":1.755864,"redis_calls":13,"redis_duration_s":0.001699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000616,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01656,"completed_at":"2026-08-11T10:11:47.993Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.345236] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:47.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22c545c635ce8a87506f657a","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22c545c635ce8a87506f657a: start","job_status":"start","queue_duration_s":1.77353,"scheduling_latency_s":1.773546} gitlab # [ 241.357928] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22c545c635ce8a87506f657a","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22c545c635ce8a87506f657a: done: 0.019004 sec","job_status":"done","queue_duration_s":1.77353,"scheduling_latency_s":1.773546,"redis_calls":13,"redis_duration_s":0.002063,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000623,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00144,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019004,"completed_at":"2026-08-11T10:11:48.013Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.397717] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"273a1f92366b925ef85b512d","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-273a1f92366b925ef85b512d: start","job_status":"start","queue_duration_s":1.793717,"scheduling_latency_s":1.793733} gitlab # [ 241.410245] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"273a1f92366b925ef85b512d","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-273a1f92366b925ef85b512d: done: 0.015782 sec","job_status":"done","queue_duration_s":1.793717,"scheduling_latency_s":1.793733,"redis_calls":13,"redis_duration_s":0.0015760000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015782,"completed_at":"2026-08-11T10:11:48.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.451295] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"819d75b9640f681c5e15d1df","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-819d75b9640f681c5e15d1df: start","job_status":"start","queue_duration_s":1.810699,"scheduling_latency_s":1.810715} gitlab # [ 241.464173] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"819d75b9640f681c5e15d1df","created_at":"2026-08-11T10:11:46.136Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d6c138af3908472c","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"52be77b60d11c9dcfaf26d5ef7d5deaf","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.221Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-819d75b9640f681c5e15d1df: done: 0.016189 sec","job_status":"done","queue_duration_s":1.810699,"scheduling_latency_s":1.810715,"redis_calls":13,"redis_duration_s":0.0015869999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000615,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016189,"completed_at":"2026-08-11T10:11:48.048Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.504409] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.049Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b8a0369c4d67c55178cdbe88","created_at":"2026-08-11T10:11:46.976Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-b828fba76f8a4be4","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2ec8b9b8b634998e013c9e0b1dce4ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.989Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b8a0369c4d67c55178cdbe88: start","job_status":"start","queue_duration_s":1.0599,"scheduling_latency_s":1.059917} gitlab # [ 241.517042] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.069Z","message":"No existing merge request to be cleaned up."} gitlab # [ 241.518697] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.084Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b8a0369c4d67c55178cdbe88","created_at":"2026-08-11T10:11:46.976Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-b828fba76f8a4be4","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2ec8b9b8b634998e013c9e0b1dce4ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.989Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b8a0369c4d67c55178cdbe88: done: 0.034542 sec","job_status":"done","queue_duration_s":1.0599,"scheduling_latency_s":1.059917,"redis_calls":13,"redis_duration_s":0.0018599999999999999,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000293,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002738,"duration_s":0.034542,"completed_at":"2026-08-11T10:11:48.084Z","load_balancing_strategy":"primary","db_duration_s":0.006548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.559506] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.085Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0850f6f438d0f943d7ecbc5a","created_at":"2026-08-11T10:11:46.976Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-b828fba76f8a4be4","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2ec8b9b8b634998e013c9e0b1dce4ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.989Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0850f6f438d0f943d7ecbc5a: start","job_status":"start","queue_duration_s":1.095543,"scheduling_latency_s":1.095559} gitlab # [ 241.571899] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.096Z","message":"No existing merge request to be cleaned up."} gitlab # [ 241.573646] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.103Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0850f6f438d0f943d7ecbc5a","created_at":"2026-08-11T10:11:46.976Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-b828fba76f8a4be4","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2ec8b9b8b634998e013c9e0b1dce4ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.989Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0850f6f438d0f943d7ecbc5a: done: 0.018439 sec","job_status":"done","queue_duration_s":1.095543,"scheduling_latency_s":1.095559,"redis_calls":10,"redis_duration_s":0.001365,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000781,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018439,"completed_at":"2026-08-11T10:11:48.103Z","load_balancing_strategy":"primary","db_duration_s":0.002503,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.612266] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.105Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"99310cd66182fed7750765c5","created_at":"2026-08-11T10:11:46.976Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-b828fba76f8a4be4","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2ec8b9b8b634998e013c9e0b1dce4ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.989Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-99310cd66182fed7750765c5: start","job_status":"start","queue_duration_s":1.115187,"scheduling_latency_s":1.115203} gitlab # [ 241.625710] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.115Z","message":"No existing merge request to be cleaned up."} gitlab # [ 241.627435] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.123Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"99310cd66182fed7750765c5","created_at":"2026-08-11T10:11:46.976Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-b828fba76f8a4be4","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2ec8b9b8b634998e013c9e0b1dce4ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.989Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-99310cd66182fed7750765c5: done: 0.018585 sec","job_status":"done","queue_duration_s":1.115187,"scheduling_latency_s":1.115203,"redis_calls":10,"redis_duration_s":0.001438,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000837,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018585,"completed_at":"2026-08-11T10:11:48.123Z","load_balancing_strategy":"primary","db_duration_s":0.002539,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.667642] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.124Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4538c2376d523eb681ead4dc","created_at":"2026-08-11T10:11:46.976Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-b828fba76f8a4be4","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2ec8b9b8b634998e013c9e0b1dce4ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.989Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4538c2376d523eb681ead4dc: start","job_status":"start","queue_duration_s":1.134955,"scheduling_latency_s":1.134972} gitlab # [ 241.680540] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.135Z","message":"No existing merge request to be cleaned up."} gitlab # [ 241.682190] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:11:48.142Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4538c2376d523eb681ead4dc","created_at":"2026-08-11T10:11:46.976Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-b828fba76f8a4be4","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"2ec8b9b8b634998e013c9e0b1dce4ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:11:46.989Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4538c2376d523eb681ead4dc: done: 0.018056 sec","job_status":"done","queue_duration_s":1.134955,"scheduling_latency_s":1.134972,"redis_calls":10,"redis_duration_s":0.0013809999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000783,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018056,"completed_at":"2026-08-11T10:11:48.142Z","load_balancing_strategy":"primary","db_duration_s":0.002173,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.233200] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.084Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c946a0d6f490920402503608","created_at":"2026-08-11T10:12:01.061Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c77da9b14e1afa9ef10edd3d9ad145bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.080Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c946a0d6f490920402503608: start","job_status":"start","queue_duration_s":0.004178,"scheduling_latency_s":0.004232} gitlab # [ 252.336499] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.189Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c946a0d6f490920402503608","created_at":"2026-08-11T10:12:01.061Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c77da9b14e1afa9ef10edd3d9ad145bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.080Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c946a0d6f490920402503608: done: 0.104429 sec","job_status":"done","queue_duration_s":0.004178,"scheduling_latency_s":0.004232,"redis_calls":9,"redis_duration_s":0.011429,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007049,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00438,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00240268,"exclusive_lock_hold_duration_s":0.01345696,"duration_s":0.104429,"completed_at":"2026-08-11T10:12:01.189Z","load_balancing_strategy":"primary","db_duration_s":0.007676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.416511] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"bced2bf6269069135e7678f9","created_at":"2026-08-11T10:12:01.096Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bad949825cd07718e1973649d0f14630","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:12:01.102Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-bced2bf6269069135e7678f9: start","job_status":"start","queue_duration_s":0.095661,"scheduling_latency_s":0.095713} gitlab # [ 252.453019] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"bced2bf6269069135e7678f9","created_at":"2026-08-11T10:12:01.096Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bad949825cd07718e1973649d0f14630","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:12:01.102Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-bced2bf6269069135e7678f9: done: 0.107054 sec","job_status":"done","queue_duration_s":0.095661,"scheduling_latency_s":0.095713,"redis_calls":7,"redis_duration_s":0.005046,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00427,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000776,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.107054,"completed_at":"2026-08-11T10:12:01.304Z","load_balancing_strategy":"primary","db_duration_s":0.044924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.523670] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"60abf56d0f623e015fb4c2ae","created_at":"2026-08-11T10:12:01.140Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"767a55cfb7db721e96466ec55e951178","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.153Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-60abf56d0f623e015fb4c2ae: start","job_status":"start","queue_duration_s":0.156926,"scheduling_latency_s":0.156977} gitlab # [ 252.539638] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.356Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 252.543111] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.394Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"60abf56d0f623e015fb4c2ae","created_at":"2026-08-11T10:12:01.140Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"767a55cfb7db721e96466ec55e951178","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.153Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-60abf56d0f623e015fb4c2ae: done: 0.083662 sec","job_status":"done","queue_duration_s":0.156926,"scheduling_latency_s":0.156977,"redis_calls":7,"redis_duration_s":0.002673,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001945,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000728,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.083662,"completed_at":"2026-08-11T10:12:01.394Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.585007] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.399Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"62da041a5345258592261ea7","created_at":"2026-08-11T10:12:01.181Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af45c319bfd568a473cb5041f6c5af3b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.194Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-62da041a5345258592261ea7: start","job_status":"start","queue_duration_s":0.204358,"scheduling_latency_s":0.204405} gitlab # [ 252.624193] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.476Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"62da041a5345258592261ea7","created_at":"2026-08-11T10:12:01.181Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af45c319bfd568a473cb5041f6c5af3b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.194Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-62da041a5345258592261ea7: done: 0.077749 sec","job_status":"done","queue_duration_s":0.204358,"scheduling_latency_s":0.204405,"redis_calls":10,"redis_duration_s":0.004118,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002344,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001774,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01186118,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.077749,"completed_at":"2026-08-11T10:12:01.476Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 252.691622] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.483Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"cc35b38c3139e4ab366f7a58","created_at":"2026-08-11T10:12:01.279Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d57aeb5b8df2ffbe791feabc6704970","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.292Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-cc35b38c3139e4ab366f7a58: start","job_status":"start","queue_duration_s":0.190955,"scheduling_latency_s":0.190999} gitlab # [ 252.878277] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.731Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"cc35b38c3139e4ab366f7a58","created_at":"2026-08-11T10:12:01.279Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d57aeb5b8df2ffbe791feabc6704970","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.292Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-cc35b38c3139e4ab366f7a58: done: 0.247601 sec","job_status":"done","queue_duration_s":0.190955,"scheduling_latency_s":0.190999,"redis_calls":9,"redis_duration_s":0.022585,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.015966,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.074,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.074,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00425896,"exclusive_lock_hold_duration_s":0.09176484,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.247601,"completed_at":"2026-08-11T10:12:01.731Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.139942,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.971010] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.740Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f7d4e72a92c08fc0d0493574","created_at":"2026-08-11T10:12:01.331Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a679e437b95dadaaeb377c2c2397ba53","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:12:01.337Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f7d4e72a92c08fc0d0493574: start","job_status":"start","queue_duration_s":0.40342,"scheduling_latency_s":0.403474} gitlab # [ 252.987673] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.774Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 252.991610] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f7d4e72a92c08fc0d0493574","created_at":"2026-08-11T10:12:01.331Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a679e437b95dadaaeb377c2c2397ba53","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:12:01.337Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f7d4e72a92c08fc0d0493574: done: 0.070898 sec","job_status":"done","queue_duration_s":0.40342,"scheduling_latency_s":0.403474,"redis_calls":7,"redis_duration_s":0.002415,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000682,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.070898,"completed_at":"2026-08-11T10:12:01.811Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.032944] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:01.814Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7c959e972280d4c3da5bc036","created_at":"2026-08-11T10:12:01.396Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff5e9e10300212ad97326a7f2538890b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.406Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7c959e972280d4c3da5bc036: start","job_status":"start","queue_duration_s":0.408305,"scheduling_latency_s":0.408346} gitlab # [ 253.703334] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.556Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7c959e972280d4c3da5bc036","created_at":"2026-08-11T10:12:01.396Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff5e9e10300212ad97326a7f2538890b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.406Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7c959e972280d4c3da5bc036: done: 0.741488 sec","job_status":"done","queue_duration_s":0.408305,"scheduling_latency_s":0.408346,"redis_calls":562,"redis_duration_s":0.30345300000000003,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00163,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.301823,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.479382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.741488,"completed_at":"2026-08-11T10:12:02.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.703943] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.557Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"059abaa1bb6328615e0b0a21","created_at":"2026-08-11T10:12:01.452Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"e3e87a0ed92cc13f2d7d3e2b71a37dee","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.480Z","job_size_bytes":3,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-059abaa1bb6328615e0b0a21: start","job_status":"start","queue_duration_s":1.077288,"scheduling_latency_s":1.077313} gitlab # [ 253.788786] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.578Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"059abaa1bb6328615e0b0a21","created_at":"2026-08-11T10:12:01.452Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"e3e87a0ed92cc13f2d7d3e2b71a37dee","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.480Z","job_size_bytes":3,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-059abaa1bb6328615e0b0a21: done: 0.020968 sec","job_status":"done","queue_duration_s":1.077288,"scheduling_latency_s":1.077313,"redis_calls":10,"redis_duration_s":0.002797,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000675,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001598,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038826,"duration_s":0.020968,"completed_at":"2026-08-11T10:12:02.578Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000953,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.898046] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"416793fdff8456a3a869d236","created_at":"2026-08-11T10:12:01.495Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.506Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-416793fdff8456a3a869d236: start","job_status":"start","queue_duration_s":1.073643,"scheduling_latency_s":1.07366} gitlab # [ 253.918866] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.744Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"416793fdff8456a3a869d236","created_at":"2026-08-11T10:12:01.495Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.506Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-416793fdff8456a3a869d236: done: 0.164083 sec","job_status":"done","queue_duration_s":1.073643,"scheduling_latency_s":1.07366,"redis_calls":60,"redis_duration_s":0.014221999999999999,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.00058,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.012556,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.151337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.164083,"completed_at":"2026-08-11T10:12:02.744Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.972667] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ea006345c244b9e304e2d1c5","created_at":"2026-08-11T10:12:01.513Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a3284787b1b5839a7ba6fca00de2b63","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:12:01.530Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ea006345c244b9e304e2d1c5: start","job_status":"start","queue_duration_s":1.215633,"scheduling_latency_s":1.215653} gitlab # [ 253.986476] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.753Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 253.990473] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ea006345c244b9e304e2d1c5","created_at":"2026-08-11T10:12:01.513Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a3284787b1b5839a7ba6fca00de2b63","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:12:01.530Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ea006345c244b9e304e2d1c5: done: 0.012574 sec","job_status":"done","queue_duration_s":1.215633,"scheduling_latency_s":1.215653,"redis_calls":7,"redis_duration_s":0.001065,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012574,"completed_at":"2026-08-11T10:12:02.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.030668] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.760Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2296266cfd583f4733365131","created_at":"2026-08-11T10:12:01.579Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b95a5c0becfef3813a52b3739799d83c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.584Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2296266cfd583f4733365131: start","job_status":"start","queue_duration_s":1.175291,"scheduling_latency_s":1.175308} gitlab # [ 254.045575] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.767Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 254.048942] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.773Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2296266cfd583f4733365131","created_at":"2026-08-11T10:12:01.579Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b95a5c0becfef3813a52b3739799d83c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.584Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2296266cfd583f4733365131: done: 0.013293 sec","job_status":"done","queue_duration_s":1.175291,"scheduling_latency_s":1.175308,"redis_calls":7,"redis_duration_s":0.001526,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000379,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013293,"completed_at":"2026-08-11T10:12:02.773Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.091053] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"ed281c334c2cc123a4a48ff9","created_at":"2026-08-11T10:12:01.603Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"688e3e2ff120520cfd6c1cd4135cada9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.618Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-ed281c334c2cc123a4a48ff9: start","job_status":"start","queue_duration_s":1.156879,"scheduling_latency_s":1.156895} gitlab # [ 254.105872] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.803Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"ed281c334c2cc123a4a48ff9","created_at":"2026-08-11T10:12:01.603Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"688e3e2ff120520cfd6c1cd4135cada9","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.618Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-ed281c334c2cc123a4a48ff9: done: 0.028851 sec","job_status":"done","queue_duration_s":1.156879,"scheduling_latency_s":1.156895,"redis_calls":12,"redis_duration_s":0.003097,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000574,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00060708,"exclusive_lock_hold_duration_s":0.00576194,"duration_s":0.028851,"completed_at":"2026-08-11T10:12:02.803Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.148061] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.805Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5c4296ed3801a6f5a9dd05b6","created_at":"2026-08-11T10:12:01.626Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5976483ead03a8c1ffd4272caa777ab3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.635Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5c4296ed3801a6f5a9dd05b6: start","job_status":"start","queue_duration_s":1.170028,"scheduling_latency_s":1.170043} gitlab # [ 254.162367] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.819Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5c4296ed3801a6f5a9dd05b6","created_at":"2026-08-11T10:12:01.626Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5976483ead03a8c1ffd4272caa777ab3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.635Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5c4296ed3801a6f5a9dd05b6: done: 0.014181 sec","job_status":"done","queue_duration_s":1.170028,"scheduling_latency_s":1.170043,"redis_calls":7,"redis_duration_s":0.001881,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001363,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000518,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014181,"completed_at":"2026-08-11T10:12:02.819Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.202497] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.821Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f9166727d2d84719286ef094","created_at":"2026-08-11T10:12:01.681Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9aecc290b0bc9ad5ae928dea9b704e1a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.696Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f9166727d2d84719286ef094: start","job_status":"start","queue_duration_s":1.124725,"scheduling_latency_s":1.12474} gitlab # [ 254.216859] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.829Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 254.220352] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.834Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f9166727d2d84719286ef094","created_at":"2026-08-11T10:12:01.681Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9aecc290b0bc9ad5ae928dea9b704e1a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.696Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f9166727d2d84719286ef094: done: 0.013575 sec","job_status":"done","queue_duration_s":1.124725,"scheduling_latency_s":1.12474,"redis_calls":7,"redis_duration_s":0.0018900000000000002,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001396,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013575,"completed_at":"2026-08-11T10:12:02.834Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.260519] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"302ecf7976ef64610aeb5cda","created_at":"2026-08-11T10:12:01.710Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11ab308c4415d60ec7b1468d2ffb907f","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.727Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-302ecf7976ef64610aeb5cda: start","job_status":"start","queue_duration_s":1.108942,"scheduling_latency_s":1.108957} gitlab # [ 254.276137] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.865Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"302ecf7976ef64610aeb5cda","created_at":"2026-08-11T10:12:01.710Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11ab308c4415d60ec7b1468d2ffb907f","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.727Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-302ecf7976ef64610aeb5cda: done: 0.029729 sec","job_status":"done","queue_duration_s":1.108942,"scheduling_latency_s":1.108957,"redis_calls":10,"redis_duration_s":0.002427,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000507,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001431,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000489,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033336,"duration_s":0.029729,"completed_at":"2026-08-11T10:12:02.865Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003124,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.319044] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:02.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0ffbc6796aa46516252d2f6f","created_at":"2026-08-11T10:12:01.739Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c27731b556d983885cf34003f30d1afd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.746Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0ffbc6796aa46516252d2f6f: start","job_status":"start","queue_duration_s":1.120341,"scheduling_latency_s":1.120356} gitlab # [ 254.346779] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0ffbc6796aa46516252d2f6f","created_at":"2026-08-11T10:12:01.739Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c27731b556d983885cf34003f30d1afd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.746Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0ffbc6796aa46516252d2f6f: done: 0.333504 sec","job_status":"done","queue_duration_s":1.120341,"scheduling_latency_s":1.120356,"redis_calls":11,"redis_duration_s":0.0030470000000000002,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001273,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001294,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.279313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062076,"exclusive_lock_hold_duration_s":0.31464992,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.333504,"completed_at":"2026-08-11T10:12:03.200Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.07157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.391207] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"54b9ff1d4c4d738aebcc7d09","created_at":"2026-08-11T10:12:01.800Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8e80da546054a1295db34dd79398443","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.807Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-54b9ff1d4c4d738aebcc7d09: start","job_status":"start","queue_duration_s":1.394956,"scheduling_latency_s":1.394974} gitlab # [ 254.405889] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.258Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"54b9ff1d4c4d738aebcc7d09","created_at":"2026-08-11T10:12:01.800Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8e80da546054a1295db34dd79398443","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.807Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-54b9ff1d4c4d738aebcc7d09: done: 0.056112 sec","job_status":"done","queue_duration_s":1.394956,"scheduling_latency_s":1.394974,"redis_calls":9,"redis_duration_s":0.002745,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001458,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065436,"exclusive_lock_hold_duration_s":0.03286616,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.056112,"completed_at":"2026-08-11T10:12:03.258Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.448568] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.261Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8e39adc5ea23d2b036fdf374","created_at":"2026-08-11T10:12:01.900Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f59473715295535e20ef7bc82c1e582b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.950Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8e39adc5ea23d2b036fdf374: start","job_status":"start","queue_duration_s":1.310792,"scheduling_latency_s":1.310829} gitlab # [ 254.462819] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.289Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8e39adc5ea23d2b036fdf374","created_at":"2026-08-11T10:12:01.900Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f59473715295535e20ef7bc82c1e582b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.950Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8e39adc5ea23d2b036fdf374: done: 0.028393 sec","job_status":"done","queue_duration_s":1.310792,"scheduling_latency_s":1.310829,"redis_calls":7,"redis_duration_s":0.002118,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00156,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028393,"completed_at":"2026-08-11T10:12:03.289Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.504697] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.292Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3da12d6e4a8f5fd35663a5ed","created_at":"2026-08-11T10:12:01.960Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"421a724d4e2d56abdc99c17f57de13e9","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.965Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3da12d6e4a8f5fd35663a5ed: start","job_status":"start","queue_duration_s":1.327455,"scheduling_latency_s":1.327482} gitlab # [ 254.519145] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.319Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3da12d6e4a8f5fd35663a5ed","created_at":"2026-08-11T10:12:01.960Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"421a724d4e2d56abdc99c17f57de13e9","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.965Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3da12d6e4a8f5fd35663a5ed: done: 0.026455 sec","job_status":"done","queue_duration_s":1.327455,"scheduling_latency_s":1.327482,"redis_calls":9,"redis_duration_s":0.003142,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001611,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001531,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00081746,"exclusive_lock_hold_duration_s":0.0031366,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.026455,"completed_at":"2026-08-11T10:12:03.319Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000706,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.560576] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.321Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"c959aa10bc3a9742ad44241f","created_at":"2026-08-11T10:12:01.977Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a84e3d2cfcde1a48051700f55fe6493d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.991Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-c959aa10bc3a9742ad44241f: start","job_status":"start","queue_duration_s":1.330032,"scheduling_latency_s":1.330059} gitlab # [ 254.574965] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"c959aa10bc3a9742ad44241f","created_at":"2026-08-11T10:12:01.977Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a84e3d2cfcde1a48051700f55fe6493d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:01.991Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-c959aa10bc3a9742ad44241f: done: 0.031042 sec","job_status":"done","queue_duration_s":1.330032,"scheduling_latency_s":1.330059,"redis_calls":12,"redis_duration_s":0.003523,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000588,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001651,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001284,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040718,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.031042,"completed_at":"2026-08-11T10:12:03.352Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.620048] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.354Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4f5e22f98366e2046323d3b2","created_at":"2026-08-11T10:12:02.016Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5cedb66b2bef87ca0f74766fc904ae7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.022Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4f5e22f98366e2046323d3b2: start","job_status":"start","queue_duration_s":1.331399,"scheduling_latency_s":1.331418} gitlab # [ 254.634907] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.364Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 254.638887] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.370Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"4f5e22f98366e2046323d3b2","created_at":"2026-08-11T10:12:02.016Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5cedb66b2bef87ca0f74766fc904ae7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.022Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-4f5e22f98366e2046323d3b2: done: 0.016454 sec","job_status":"done","queue_duration_s":1.331399,"scheduling_latency_s":1.331418,"redis_calls":7,"redis_duration_s":0.001909,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001378,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000531,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016454,"completed_at":"2026-08-11T10:12:03.370Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.680299] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.372Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d5c0d38cc36f79d27f79df4b","created_at":"2026-08-11T10:12:02.048Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb1d0cf3d800758f8fafcbc96672b3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.055Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d5c0d38cc36f79d27f79df4b: start","job_status":"start","queue_duration_s":1.316722,"scheduling_latency_s":1.316739} gitlab # [ 254.695414] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.394Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d5c0d38cc36f79d27f79df4b","created_at":"2026-08-11T10:12:02.048Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb1d0cf3d800758f8fafcbc96672b3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.055Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d5c0d38cc36f79d27f79df4b: done: 0.021883 sec","job_status":"done","queue_duration_s":1.316722,"scheduling_latency_s":1.316739,"redis_calls":7,"redis_duration_s":0.0017599999999999998,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001287,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021883,"completed_at":"2026-08-11T10:12:03.394Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.737124] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.395Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d44751c00f7f40b76c208d98","created_at":"2026-08-11T10:12:02.071Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f56917daa866fa12a71cca6ff0906da","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.079Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d44751c00f7f40b76c208d98: start","job_status":"start","queue_duration_s":1.316857,"scheduling_latency_s":1.316872} gitlab # [ 254.751484] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.412Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d44751c00f7f40b76c208d98","created_at":"2026-08-11T10:12:02.071Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f56917daa866fa12a71cca6ff0906da","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.079Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d44751c00f7f40b76c208d98: done: 0.016833 sec","job_status":"done","queue_duration_s":1.316857,"scheduling_latency_s":1.316872,"redis_calls":7,"redis_duration_s":0.0018019999999999998,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.016833,"completed_at":"2026-08-11T10:12:03.412Z","load_balancing_strategy":"primary","db_duration_s":0.001537,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.792645] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.414Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e0405ac291a75393fabc72b5","created_at":"2026-08-11T10:12:02.095Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"653d01079b4f24cd1f6c4d1ad7de946e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.103Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e0405ac291a75393fabc72b5: start","job_status":"start","queue_duration_s":1.31015,"scheduling_latency_s":1.310165} gitlab # [ 254.806421] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.429Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e0405ac291a75393fabc72b5","created_at":"2026-08-11T10:12:02.095Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"653d01079b4f24cd1f6c4d1ad7de946e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.103Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e0405ac291a75393fabc72b5: done: 0.015527 sec","job_status":"done","queue_duration_s":1.31015,"scheduling_latency_s":1.310165,"redis_calls":7,"redis_duration_s":0.0019270000000000001,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001347,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00058,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015527,"completed_at":"2026-08-11T10:12:03.429Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000552,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.846601] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.431Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"2c8d725ae6d86f3c2ba7fc93","created_at":"2026-08-11T10:12:02.124Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26146c268077165d272568eafa2aa4ef","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.132Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-2c8d725ae6d86f3c2ba7fc93: start","job_status":"start","queue_duration_s":1.298544,"scheduling_latency_s":1.29856} gitlab # [ 254.860191] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"2c8d725ae6d86f3c2ba7fc93","created_at":"2026-08-11T10:12:02.124Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"26146c268077165d272568eafa2aa4ef","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.132Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-2c8d725ae6d86f3c2ba7fc93: done: 0.027405 sec","job_status":"done","queue_duration_s":1.298544,"scheduling_latency_s":1.29856,"redis_calls":14,"redis_duration_s":0.003517,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000357,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002324,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000836,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027405,"completed_at":"2026-08-11T10:12:03.458Z","load_balancing_strategy":"primary","db_duration_s":0.000559,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.902604] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.459Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"8edbb2a8b5788c2c3bdf84f4","created_at":"2026-08-11T10:12:02.166Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"016f910590bd3a62cd3bfca546483b2a","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.191Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-8edbb2a8b5788c2c3bdf84f4: start","job_status":"start","queue_duration_s":1.268542,"scheduling_latency_s":1.268558} gitlab # [ 254.915724] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.479Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"8edbb2a8b5788c2c3bdf84f4","created_at":"2026-08-11T10:12:02.166Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"016f910590bd3a62cd3bfca546483b2a","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.191Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-8edbb2a8b5788c2c3bdf84f4: done: 0.019854 sec","job_status":"done","queue_duration_s":1.268542,"scheduling_latency_s":1.268558,"redis_calls":12,"redis_duration_s":0.003045,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000578,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000485,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001488,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039992,"duration_s":0.019854,"completed_at":"2026-08-11T10:12:03.479Z","load_balancing_strategy":"primary","db_duration_s":0.000332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.959754] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e530802e8617d902f2aac19a","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e530802e8617d902f2aac19a: start","job_status":"start","queue_duration_s":0.744276,"scheduling_latency_s":0.744291} gitlab # [ 254.972696] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e530802e8617d902f2aac19a","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e530802e8617d902f2aac19a: done: 0.016949 sec","job_status":"done","queue_duration_s":0.744276,"scheduling_latency_s":0.744291,"redis_calls":13,"redis_duration_s":0.003618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001435,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016949,"completed_at":"2026-08-11T10:12:03.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.012584] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f9810198dadb457c83423e2","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f9810198dadb457c83423e2: start","job_status":"start","queue_duration_s":0.762551,"scheduling_latency_s":0.762566} gitlab # [ 255.025336] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f9810198dadb457c83423e2","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f9810198dadb457c83423e2: done: 0.016708 sec","job_status":"done","queue_duration_s":0.762551,"scheduling_latency_s":0.762566,"redis_calls":13,"redis_duration_s":0.00258,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001638,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016708,"completed_at":"2026-08-11T10:12:03.516Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.064827] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6535932c9352d3c11f652d15","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6535932c9352d3c11f652d15: start","job_status":"start","queue_duration_s":0.780666,"scheduling_latency_s":0.78068} gitlab # [ 255.076886] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6535932c9352d3c11f652d15","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6535932c9352d3c11f652d15: done: 0.015717 sec","job_status":"done","queue_duration_s":0.780666,"scheduling_latency_s":0.78068,"redis_calls":13,"redis_duration_s":0.00311,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001035,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002075,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015717,"completed_at":"2026-08-11T10:12:03.533Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.116659] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a978733a83bee1fa1645e18","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a978733a83bee1fa1645e18: start","job_status":"start","queue_duration_s":0.797818,"scheduling_latency_s":0.797834} gitlab # [ 255.129121] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a978733a83bee1fa1645e18","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a978733a83bee1fa1645e18: done: 0.015219 sec","job_status":"done","queue_duration_s":0.797818,"scheduling_latency_s":0.797834,"redis_calls":13,"redis_duration_s":0.002693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015219,"completed_at":"2026-08-11T10:12:03.550Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.167848] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbd81dcca9687ccac1714ebf","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbd81dcca9687ccac1714ebf: start","job_status":"start","queue_duration_s":0.814416,"scheduling_latency_s":0.814432} gitlab # [ 255.180455] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbd81dcca9687ccac1714ebf","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbd81dcca9687ccac1714ebf: done: 0.015336 sec","job_status":"done","queue_duration_s":0.814416,"scheduling_latency_s":0.814432,"redis_calls":13,"redis_duration_s":0.002899,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015336,"completed_at":"2026-08-11T10:12:03.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.219501] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3edb1b92b4b4e1057d76be0","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3edb1b92b4b4e1057d76be0: start","job_status":"start","queue_duration_s":0.831368,"scheduling_latency_s":0.831384} gitlab # [ 255.231911] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3edb1b92b4b4e1057d76be0","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3edb1b92b4b4e1057d76be0: done: 0.015607 sec","job_status":"done","queue_duration_s":0.831368,"scheduling_latency_s":0.831384,"redis_calls":13,"redis_duration_s":0.003216,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001233,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015607,"completed_at":"2026-08-11T10:12:03.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.271672] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01d5cbac2976dd593dd2801c","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01d5cbac2976dd593dd2801c: start","job_status":"start","queue_duration_s":0.848432,"scheduling_latency_s":0.848447} gitlab # [ 255.284730] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01d5cbac2976dd593dd2801c","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01d5cbac2976dd593dd2801c: done: 0.015379 sec","job_status":"done","queue_duration_s":0.848432,"scheduling_latency_s":0.848447,"redis_calls":13,"redis_duration_s":0.003154,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00218,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015379,"completed_at":"2026-08-11T10:12:03.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.325902] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8e375b5675bdd773de2e0de","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8e375b5675bdd773de2e0de: start","job_status":"start","queue_duration_s":0.86518,"scheduling_latency_s":0.865195} gitlab # [ 255.338814] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8e375b5675bdd773de2e0de","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8e375b5675bdd773de2e0de: done: 0.01507 sec","job_status":"done","queue_duration_s":0.86518,"scheduling_latency_s":0.865195,"redis_calls":13,"redis_duration_s":0.002772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01507,"completed_at":"2026-08-11T10:12:03.617Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.378792] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ede1ef819490c289d14e34f","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ede1ef819490c289d14e34f: start","job_status":"start","queue_duration_s":0.881724,"scheduling_latency_s":0.88174} gitlab # [ 255.391386] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ede1ef819490c289d14e34f","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ede1ef819490c289d14e34f: done: 0.015284 sec","job_status":"done","queue_duration_s":0.881724,"scheduling_latency_s":0.88174,"redis_calls":13,"redis_duration_s":0.0028079999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001846,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015284,"completed_at":"2026-08-11T10:12:03.634Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.433988] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b238e0a0cbb32e47ac7d4591","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b238e0a0cbb32e47ac7d4591: start","job_status":"start","queue_duration_s":0.898666,"scheduling_latency_s":0.898681} gitlab # [ 255.446967] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b238e0a0cbb32e47ac7d4591","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b238e0a0cbb32e47ac7d4591: done: 0.027503 sec","job_status":"done","queue_duration_s":0.898666,"scheduling_latency_s":0.898681,"redis_calls":13,"redis_duration_s":0.004119,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001393,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002726,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027503,"completed_at":"2026-08-11T10:12:03.663Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.486664] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"556d0e432f2b46664f8acc27","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-556d0e432f2b46664f8acc27: start","job_status":"start","queue_duration_s":0.929236,"scheduling_latency_s":0.929276} gitlab # [ 255.500510] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"556d0e432f2b46664f8acc27","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-556d0e432f2b46664f8acc27: done: 0.034108 sec","job_status":"done","queue_duration_s":0.929236,"scheduling_latency_s":0.929276,"redis_calls":13,"redis_duration_s":0.003843,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002252,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034108,"completed_at":"2026-08-11T10:12:03.700Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.540557] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72f5bcf6c1c8d0829c4494a1","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72f5bcf6c1c8d0829c4494a1: start","job_status":"start","queue_duration_s":0.965227,"scheduling_latency_s":0.965256} gitlab # [ 255.553661] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72f5bcf6c1c8d0829c4494a1","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72f5bcf6c1c8d0829c4494a1: done: 0.02225 sec","job_status":"done","queue_duration_s":0.965227,"scheduling_latency_s":0.965256,"redis_calls":13,"redis_duration_s":0.002233,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001438,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02225,"completed_at":"2026-08-11T10:12:03.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.593246] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac1fb7b3466b28ea97cacf01","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac1fb7b3466b28ea97cacf01: start","job_status":"start","queue_duration_s":0.988936,"scheduling_latency_s":0.988958} gitlab # [ 255.605921] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac1fb7b3466b28ea97cacf01","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac1fb7b3466b28ea97cacf01: done: 0.018597 sec","job_status":"done","queue_duration_s":0.988936,"scheduling_latency_s":0.988958,"redis_calls":13,"redis_duration_s":0.0019649999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018597,"completed_at":"2026-08-11T10:12:03.744Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.646119] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2b8cb1e3b305631ed70f30f","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2b8cb1e3b305631ed70f30f: start","job_status":"start","queue_duration_s":1.008798,"scheduling_latency_s":1.008816} gitlab # [ 255.658846] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2b8cb1e3b305631ed70f30f","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2b8cb1e3b305631ed70f30f: done: 0.015727 sec","job_status":"done","queue_duration_s":1.008798,"scheduling_latency_s":1.008816,"redis_calls":13,"redis_duration_s":0.00175,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000609,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015727,"completed_at":"2026-08-11T10:12:03.761Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.699055] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d51e41cb51316fca20960e0","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d51e41cb51316fca20960e0: start","job_status":"start","queue_duration_s":1.02571,"scheduling_latency_s":1.025727} gitlab # [ 255.712870] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d51e41cb51316fca20960e0","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d51e41cb51316fca20960e0: done: 0.014623 sec","job_status":"done","queue_duration_s":1.02571,"scheduling_latency_s":1.025727,"redis_calls":13,"redis_duration_s":0.0016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014623,"completed_at":"2026-08-11T10:12:03.777Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.752686] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab5a87f71608053e160d776e","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab5a87f71608053e160d776e: start","job_status":"start","queue_duration_s":1.041459,"scheduling_latency_s":1.041516} gitlab # [ 255.765094] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab5a87f71608053e160d776e","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab5a87f71608053e160d776e: done: 0.014868 sec","job_status":"done","queue_duration_s":1.041459,"scheduling_latency_s":1.041516,"redis_calls":13,"redis_duration_s":0.0015929999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014868,"completed_at":"2026-08-11T10:12:03.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.805223] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06a8be81df137b1bcf9b47a2","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06a8be81df137b1bcf9b47a2: start","job_status":"start","queue_duration_s":1.057715,"scheduling_latency_s":1.057732} gitlab # [ 255.817923] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06a8be81df137b1bcf9b47a2","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06a8be81df137b1bcf9b47a2: done: 0.014846 sec","job_status":"done","queue_duration_s":1.057715,"scheduling_latency_s":1.057732,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014846,"completed_at":"2026-08-11T10:12:03.809Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.857838] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34523ff2f685a59fbef42278","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34523ff2f685a59fbef42278: start","job_status":"start","queue_duration_s":1.073677,"scheduling_latency_s":1.073694} gitlab # [ 255.870261] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34523ff2f685a59fbef42278","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34523ff2f685a59fbef42278: done: 0.015144 sec","job_status":"done","queue_duration_s":1.073677,"scheduling_latency_s":1.073694,"redis_calls":13,"redis_duration_s":0.001725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015144,"completed_at":"2026-08-11T10:12:03.825Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.909644] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ba1389884c4320cef621940","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ba1389884c4320cef621940: start","job_status":"start","queue_duration_s":1.090024,"scheduling_latency_s":1.090041} gitlab # [ 255.922014] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ba1389884c4320cef621940","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ba1389884c4320cef621940: done: 0.015639 sec","job_status":"done","queue_duration_s":1.090024,"scheduling_latency_s":1.090041,"redis_calls":13,"redis_duration_s":0.001862,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015639,"completed_at":"2026-08-11T10:12:03.842Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.961192] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6637b6501d6031a010368d0","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6637b6501d6031a010368d0: start","job_status":"start","queue_duration_s":1.106785,"scheduling_latency_s":1.106802} gitlab # [ 255.973596] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6637b6501d6031a010368d0","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6637b6501d6031a010368d0: done: 0.01484 sec","job_status":"done","queue_duration_s":1.106785,"scheduling_latency_s":1.106802,"redis_calls":13,"redis_duration_s":0.001578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01484,"completed_at":"2026-08-11T10:12:03.858Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.012634] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f570a33dbcac95b95ec24e57","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f570a33dbcac95b95ec24e57: start","job_status":"start","queue_duration_s":1.12291,"scheduling_latency_s":1.122927} gitlab # [ 256.025135] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f570a33dbcac95b95ec24e57","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f570a33dbcac95b95ec24e57: done: 0.014527 sec","job_status":"done","queue_duration_s":1.12291,"scheduling_latency_s":1.122927,"redis_calls":13,"redis_duration_s":0.001576,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014527,"completed_at":"2026-08-11T10:12:03.874Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.064484] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41d4ea750a7e5767f16fdcf2","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41d4ea750a7e5767f16fdcf2: start","job_status":"start","queue_duration_s":1.138607,"scheduling_latency_s":1.138623} gitlab # [ 256.076494] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41d4ea750a7e5767f16fdcf2","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41d4ea750a7e5767f16fdcf2: done: 0.014317 sec","job_status":"done","queue_duration_s":1.138607,"scheduling_latency_s":1.138623,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014317,"completed_at":"2026-08-11T10:12:03.889Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.116805] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17cb707fa7985c01ebae67b8","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17cb707fa7985c01ebae67b8: start","job_status":"start","queue_duration_s":1.154044,"scheduling_latency_s":1.154074} gitlab # [ 256.129145] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17cb707fa7985c01ebae67b8","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17cb707fa7985c01ebae67b8: done: 0.014626 sec","job_status":"done","queue_duration_s":1.154044,"scheduling_latency_s":1.154074,"redis_calls":13,"redis_duration_s":0.001773,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014626,"completed_at":"2026-08-11T10:12:03.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.167742] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36d99ddfd4d8378e6ef16738","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36d99ddfd4d8378e6ef16738: start","job_status":"start","queue_duration_s":1.169894,"scheduling_latency_s":1.169911} gitlab # [ 256.180107] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36d99ddfd4d8378e6ef16738","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36d99ddfd4d8378e6ef16738: done: 0.01445 sec","job_status":"done","queue_duration_s":1.169894,"scheduling_latency_s":1.169911,"redis_calls":13,"redis_duration_s":0.0016380000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01445,"completed_at":"2026-08-11T10:12:03.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.219622] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05042a4d806569a9fdb5c06a","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05042a4d806569a9fdb5c06a: start","job_status":"start","queue_duration_s":1.185455,"scheduling_latency_s":1.18549} gitlab # [ 256.232346] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05042a4d806569a9fdb5c06a","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05042a4d806569a9fdb5c06a: done: 0.014283 sec","job_status":"done","queue_duration_s":1.185455,"scheduling_latency_s":1.18549,"redis_calls":13,"redis_duration_s":0.001557,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014283,"completed_at":"2026-08-11T10:12:03.936Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.271685] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44d94bce0dff90872e9d9da7","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44d94bce0dff90872e9d9da7: start","job_status":"start","queue_duration_s":1.200832,"scheduling_latency_s":1.200849} gitlab # [ 256.284751] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44d94bce0dff90872e9d9da7","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44d94bce0dff90872e9d9da7: done: 0.014543 sec","job_status":"done","queue_duration_s":1.200832,"scheduling_latency_s":1.200849,"redis_calls":13,"redis_duration_s":0.001604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000585,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014543,"completed_at":"2026-08-11T10:12:03.952Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.325438] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0af94110f28fa108c79b5211","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0af94110f28fa108c79b5211: start","job_status":"start","queue_duration_s":1.216525,"scheduling_latency_s":1.216542} gitlab # [ 256.337765] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0af94110f28fa108c79b5211","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0af94110f28fa108c79b5211: done: 0.014435 sec","job_status":"done","queue_duration_s":1.216525,"scheduling_latency_s":1.216542,"redis_calls":13,"redis_duration_s":0.001558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014435,"completed_at":"2026-08-11T10:12:03.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.377380] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8d9072ac473aef335ba3514","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8d9072ac473aef335ba3514: start","job_status":"start","queue_duration_s":1.232041,"scheduling_latency_s":1.232057} gitlab # [ 256.390118] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8d9072ac473aef335ba3514","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8d9072ac473aef335ba3514: done: 0.014477 sec","job_status":"done","queue_duration_s":1.232041,"scheduling_latency_s":1.232057,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014477,"completed_at":"2026-08-11T10:12:03.983Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.429578] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d1b766fbe604a78774898f5","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d1b766fbe604a78774898f5: start","job_status":"start","queue_duration_s":1.247599,"scheduling_latency_s":1.247616} gitlab # [ 256.442221] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:03.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d1b766fbe604a78774898f5","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d1b766fbe604a78774898f5: done: 0.01498 sec","job_status":"done","queue_duration_s":1.247599,"scheduling_latency_s":1.247616,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01498,"completed_at":"2026-08-11T10:12:03.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.481955] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"340be075e9c710decd5e812c","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-340be075e9c710decd5e812c: start","job_status":"start","queue_duration_s":1.263668,"scheduling_latency_s":1.263685} gitlab # [ 256.494407] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"340be075e9c710decd5e812c","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-340be075e9c710decd5e812c: done: 0.014302 sec","job_status":"done","queue_duration_s":1.263668,"scheduling_latency_s":1.263685,"redis_calls":13,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014302,"completed_at":"2026-08-11T10:12:04.014Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.535419] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90587115dc29691ffa8b51ac","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90587115dc29691ffa8b51ac: start","job_status":"start","queue_duration_s":1.279097,"scheduling_latency_s":1.279114} gitlab # [ 256.547899] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90587115dc29691ffa8b51ac","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90587115dc29691ffa8b51ac: done: 0.014251 sec","job_status":"done","queue_duration_s":1.279097,"scheduling_latency_s":1.279114,"redis_calls":13,"redis_duration_s":0.001511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014251,"completed_at":"2026-08-11T10:12:04.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.587251] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"400361c685ebf571d51c4203","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-400361c685ebf571d51c4203: start","job_status":"start","queue_duration_s":1.294667,"scheduling_latency_s":1.294684} gitlab # [ 256.599932] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"400361c685ebf571d51c4203","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-400361c685ebf571d51c4203: done: 0.014425 sec","job_status":"done","queue_duration_s":1.294667,"scheduling_latency_s":1.294684,"redis_calls":13,"redis_duration_s":0.001562,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014425,"completed_at":"2026-08-11T10:12:04.046Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.639088] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed3b7a6844678e485dd73a4f","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed3b7a6844678e485dd73a4f: start","job_status":"start","queue_duration_s":1.310248,"scheduling_latency_s":1.310265} gitlab # [ 256.651228] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed3b7a6844678e485dd73a4f","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed3b7a6844678e485dd73a4f: done: 0.014324 sec","job_status":"done","queue_duration_s":1.310248,"scheduling_latency_s":1.310265,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014324,"completed_at":"2026-08-11T10:12:04.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.690428] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef614e2b3a69081e3dbb4f84","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef614e2b3a69081e3dbb4f84: start","job_status":"start","queue_duration_s":1.325691,"scheduling_latency_s":1.325708} gitlab # [ 256.703132] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef614e2b3a69081e3dbb4f84","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef614e2b3a69081e3dbb4f84: done: 0.014438 sec","job_status":"done","queue_duration_s":1.325691,"scheduling_latency_s":1.325708,"redis_calls":13,"redis_duration_s":0.0016129999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014438,"completed_at":"2026-08-11T10:12:04.077Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.743535] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2959c66b2bd15968f9a8279","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2959c66b2bd15968f9a8279: start","job_status":"start","queue_duration_s":1.341265,"scheduling_latency_s":1.341282} gitlab # [ 256.756341] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2959c66b2bd15968f9a8279","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2959c66b2bd15968f9a8279: done: 0.014253 sec","job_status":"done","queue_duration_s":1.341265,"scheduling_latency_s":1.341282,"redis_calls":13,"redis_duration_s":0.0015569999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014253,"completed_at":"2026-08-11T10:12:04.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.796063] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c55b06251ce2be28a8cd60ea","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c55b06251ce2be28a8cd60ea: start","job_status":"start","queue_duration_s":1.35672,"scheduling_latency_s":1.356736} gitlab # [ 256.808301] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c55b06251ce2be28a8cd60ea","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c55b06251ce2be28a8cd60ea: done: 0.015062 sec","job_status":"done","queue_duration_s":1.35672,"scheduling_latency_s":1.356736,"redis_calls":13,"redis_duration_s":0.001771,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015062,"completed_at":"2026-08-11T10:12:04.108Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.847623] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6917332eff8122e64b8f39ae","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6917332eff8122e64b8f39ae: start","job_status":"start","queue_duration_s":1.372886,"scheduling_latency_s":1.372902} gitlab # [ 256.860271] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6917332eff8122e64b8f39ae","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6917332eff8122e64b8f39ae: done: 0.01639 sec","job_status":"done","queue_duration_s":1.372886,"scheduling_latency_s":1.372902,"redis_calls":13,"redis_duration_s":0.001715,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01639,"completed_at":"2026-08-11T10:12:04.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.899583] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18d39e666fce1f232ce278e1","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18d39e666fce1f232ce278e1: start","job_status":"start","queue_duration_s":1.39071,"scheduling_latency_s":1.390727} gitlab # [ 256.912551] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18d39e666fce1f232ce278e1","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18d39e666fce1f232ce278e1: done: 0.016217 sec","job_status":"done","queue_duration_s":1.39071,"scheduling_latency_s":1.390727,"redis_calls":13,"redis_duration_s":0.0015860000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016217,"completed_at":"2026-08-11T10:12:04.143Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.953459] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"082c5d166da1e8a3ca68dc23","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-082c5d166da1e8a3ca68dc23: start","job_status":"start","queue_duration_s":1.408564,"scheduling_latency_s":1.40858} gitlab # [ 256.966131] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"082c5d166da1e8a3ca68dc23","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-082c5d166da1e8a3ca68dc23: done: 0.015473 sec","job_status":"done","queue_duration_s":1.408564,"scheduling_latency_s":1.40858,"redis_calls":13,"redis_duration_s":0.0015999999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015473,"completed_at":"2026-08-11T10:12:04.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.006423] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59aae08ebbedf65cdaad1ccb","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59aae08ebbedf65cdaad1ccb: start","job_status":"start","queue_duration_s":1.425422,"scheduling_latency_s":1.425444} gitlab # [ 257.019214] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59aae08ebbedf65cdaad1ccb","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59aae08ebbedf65cdaad1ccb: done: 0.016233 sec","job_status":"done","queue_duration_s":1.425422,"scheduling_latency_s":1.425444,"redis_calls":13,"redis_duration_s":0.001811,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001259,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016233,"completed_at":"2026-08-11T10:12:04.178Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.059593] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"270946dbecca3577f3e2718a","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-270946dbecca3577f3e2718a: start","job_status":"start","queue_duration_s":1.442712,"scheduling_latency_s":1.442726} gitlab # [ 257.072369] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"270946dbecca3577f3e2718a","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-270946dbecca3577f3e2718a: done: 0.015339 sec","job_status":"done","queue_duration_s":1.442712,"scheduling_latency_s":1.442726,"redis_calls":13,"redis_duration_s":0.0015669999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015339,"completed_at":"2026-08-11T10:12:04.195Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.112536] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c2ba4e364a7c3fde0d62f8e","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c2ba4e364a7c3fde0d62f8e: start","job_status":"start","queue_duration_s":1.459142,"scheduling_latency_s":1.459158} gitlab # [ 257.125002] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c2ba4e364a7c3fde0d62f8e","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c2ba4e364a7c3fde0d62f8e: done: 0.0156 sec","job_status":"done","queue_duration_s":1.459142,"scheduling_latency_s":1.459158,"redis_calls":13,"redis_duration_s":0.001781,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001231,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0156,"completed_at":"2026-08-11T10:12:04.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.164763] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"410be50bae4a4aab5a67a8f5","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-410be50bae4a4aab5a67a8f5: start","job_status":"start","queue_duration_s":1.475915,"scheduling_latency_s":1.475931} gitlab # [ 257.176923] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"410be50bae4a4aab5a67a8f5","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-410be50bae4a4aab5a67a8f5: done: 0.015801 sec","job_status":"done","queue_duration_s":1.475915,"scheduling_latency_s":1.475931,"redis_calls":13,"redis_duration_s":0.0016150000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015801,"completed_at":"2026-08-11T10:12:04.228Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.216811] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8c2d0c3c2bd4e36c5ebad60","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8c2d0c3c2bd4e36c5ebad60: start","job_status":"start","queue_duration_s":1.492799,"scheduling_latency_s":1.492815} gitlab # [ 257.229164] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8c2d0c3c2bd4e36c5ebad60","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8c2d0c3c2bd4e36c5ebad60: done: 0.015552 sec","job_status":"done","queue_duration_s":1.492799,"scheduling_latency_s":1.492815,"redis_calls":13,"redis_duration_s":0.002009,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001023,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015552,"completed_at":"2026-08-11T10:12:04.245Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.268625] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb450a3233564d828c3dc577","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb450a3233564d828c3dc577: start","job_status":"start","queue_duration_s":1.510023,"scheduling_latency_s":1.51004} gitlab # [ 257.281032] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb450a3233564d828c3dc577","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb450a3233564d828c3dc577: done: 0.017741 sec","job_status":"done","queue_duration_s":1.510023,"scheduling_latency_s":1.51004,"redis_calls":13,"redis_duration_s":0.001677,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017741,"completed_at":"2026-08-11T10:12:04.264Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.320175] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c91d221fad5e63192f0778a9","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c91d221fad5e63192f0778a9: start","job_status":"start","queue_duration_s":1.529353,"scheduling_latency_s":1.529369} gitlab # [ 257.333568] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c91d221fad5e63192f0778a9","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c91d221fad5e63192f0778a9: done: 0.015939 sec","job_status":"done","queue_duration_s":1.529353,"scheduling_latency_s":1.529369,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015939,"completed_at":"2026-08-11T10:12:04.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.372755] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bc528397ae68c47f5c0a943","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bc528397ae68c47f5c0a943: start","job_status":"start","queue_duration_s":1.546935,"scheduling_latency_s":1.546951} gitlab # [ 257.385018] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bc528397ae68c47f5c0a943","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bc528397ae68c47f5c0a943: done: 0.016646 sec","job_status":"done","queue_duration_s":1.546935,"scheduling_latency_s":1.546951,"redis_calls":13,"redis_duration_s":0.001637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016646,"completed_at":"2026-08-11T10:12:04.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.423984] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7255f08775449c5f92b571ab","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7255f08775449c5f92b571ab: start","job_status":"start","queue_duration_s":1.565305,"scheduling_latency_s":1.565322} gitlab # [ 257.436214] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7255f08775449c5f92b571ab","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7255f08775449c5f92b571ab: done: 0.015917 sec","job_status":"done","queue_duration_s":1.565305,"scheduling_latency_s":1.565322,"redis_calls":13,"redis_duration_s":0.001518,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015917,"completed_at":"2026-08-11T10:12:04.318Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.474738] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a5fa8ab1e1f8551f21e67b1","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a5fa8ab1e1f8551f21e67b1: start","job_status":"start","queue_duration_s":1.582761,"scheduling_latency_s":1.582778} gitlab # [ 257.487173] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a5fa8ab1e1f8551f21e67b1","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a5fa8ab1e1f8551f21e67b1: done: 0.016023 sec","job_status":"done","queue_duration_s":1.582761,"scheduling_latency_s":1.582778,"redis_calls":13,"redis_duration_s":0.0015409999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016023,"completed_at":"2026-08-11T10:12:04.335Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.526977] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e4e69e6e70ee695f62b5628","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e4e69e6e70ee695f62b5628: start","job_status":"start","queue_duration_s":1.600359,"scheduling_latency_s":1.600377} gitlab # [ 257.540488] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e4e69e6e70ee695f62b5628","created_at":"2026-08-11T10:12:02.590Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-85d69eb3d34b4cda","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e85e7348b80a0df535db376934d20fff","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:02.737Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e4e69e6e70ee695f62b5628: done: 0.016204 sec","job_status":"done","queue_duration_s":1.600359,"scheduling_latency_s":1.600377,"redis_calls":13,"redis_duration_s":0.0021650000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001132,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016204,"completed_at":"2026-08-11T10:12:04.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.580121] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.354Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0a3c7d4ea4e70b1a0527f4bf","created_at":"2026-08-11T10:12:03.441Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d39245a4fe52459b","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"26146c268077165d272568eafa2aa4ef","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:03.452Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0a3c7d4ea4e70b1a0527f4bf: start","job_status":"start","queue_duration_s":0.902507,"scheduling_latency_s":0.902523} gitlab # [ 257.592271] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.368Z","message":"No existing merge request to be cleaned up."} gitlab # [ 257.593934] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.376Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0a3c7d4ea4e70b1a0527f4bf","created_at":"2026-08-11T10:12:03.441Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d39245a4fe52459b","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"26146c268077165d272568eafa2aa4ef","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:03.452Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0a3c7d4ea4e70b1a0527f4bf: done: 0.02221 sec","job_status":"done","queue_duration_s":0.902507,"scheduling_latency_s":0.902523,"redis_calls":10,"redis_duration_s":0.001484,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000839,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02221,"completed_at":"2026-08-11T10:12:04.376Z","load_balancing_strategy":"primary","db_duration_s":0.003239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.632623] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.378Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"06778a6799b06a811223423a","created_at":"2026-08-11T10:12:03.441Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d39245a4fe52459b","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"26146c268077165d272568eafa2aa4ef","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:03.452Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-06778a6799b06a811223423a: start","job_status":"start","queue_duration_s":0.926404,"scheduling_latency_s":0.926422} gitlab # [ 257.644785] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.389Z","message":"No existing merge request to be cleaned up."} gitlab # [ 257.646394] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.397Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"06778a6799b06a811223423a","created_at":"2026-08-11T10:12:03.441Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d39245a4fe52459b","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"26146c268077165d272568eafa2aa4ef","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:03.452Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-06778a6799b06a811223423a: done: 0.019058 sec","job_status":"done","queue_duration_s":0.926404,"scheduling_latency_s":0.926422,"redis_calls":10,"redis_duration_s":0.001382,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000793,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019058,"completed_at":"2026-08-11T10:12:04.397Z","load_balancing_strategy":"primary","db_duration_s":0.002563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.685764] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.398Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bced76a23168ede2df9ea80e","created_at":"2026-08-11T10:12:03.441Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d39245a4fe52459b","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"26146c268077165d272568eafa2aa4ef","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:03.452Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bced76a23168ede2df9ea80e: start","job_status":"start","queue_duration_s":0.946558,"scheduling_latency_s":0.946574} gitlab # [ 257.698537] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.409Z","message":"No existing merge request to be cleaned up."} gitlab # [ 257.700331] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.417Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bced76a23168ede2df9ea80e","created_at":"2026-08-11T10:12:03.441Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d39245a4fe52459b","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"26146c268077165d272568eafa2aa4ef","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:03.452Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bced76a23168ede2df9ea80e: done: 0.018955 sec","job_status":"done","queue_duration_s":0.946558,"scheduling_latency_s":0.946574,"redis_calls":10,"redis_duration_s":0.001497,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018955,"completed_at":"2026-08-11T10:12:04.417Z","load_balancing_strategy":"primary","db_duration_s":0.002575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.739757] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.418Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f0139ea71fe85025a55b0fc2","created_at":"2026-08-11T10:12:03.441Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d39245a4fe52459b","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"26146c268077165d272568eafa2aa4ef","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:03.452Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f0139ea71fe85025a55b0fc2: start","job_status":"start","queue_duration_s":0.966686,"scheduling_latency_s":0.966702} gitlab # [ 257.753303] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.429Z","message":"No existing merge request to be cleaned up."} gitlab # [ 257.755036] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:12:04.437Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f0139ea71fe85025a55b0fc2","created_at":"2026-08-11T10:12:03.441Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-d39245a4fe52459b","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"26146c268077165d272568eafa2aa4ef","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:12:03.452Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f0139ea71fe85025a55b0fc2: done: 0.018478 sec","job_status":"done","queue_duration_s":0.966686,"scheduling_latency_s":0.966702,"redis_calls":10,"redis_duration_s":0.0013939999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018478,"completed_at":"2026-08-11T10:12:04.437Z","load_balancing_strategy":"primary","db_duration_s":0.002543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 273.895028] setup-gitlab-start[2972]: W, [2026-08-11T10:12:22.748134 #2972] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 309.194838] redis[789]: 10 changes in 300 seconds. Saving... gitlab # [ 309.200539] redis[789]: Background saving started by pid 3294 gitlab # [ 309.208691] redis[3294]: BGSAVE done, 462 keys saved, 0 keys skipped, 119258 bytes written. gitlab # [ 309.213064] redis[3294]: DB saved on disk gitlab # [ 309.215238] redis[3294]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB gitlab # [ 309.296340] redis[789]: Background saving terminated with success gitlab # [ 310.514638] postgres[857]: [857] LOG: checkpoint starting: time gitlab # [ 312.418909] gitaly[922]: time="2026-08-11T10:13:01.271Z" level=info msg="burden monitor stats" pid=922 gitlab # [ 313.746087] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:02.598Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"dffd42fef67482d0c3e06d40","created_at":"2026-08-11T10:13:02.527Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53429b41e63e8d702e05f17b0f3af566","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.594Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-dffd42fef67482d0c3e06d40: start","job_status":"start","queue_duration_s":0.003604,"scheduling_latency_s":0.003666} gitlab # [ 313.962151] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:02.815Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"dffd42fef67482d0c3e06d40","created_at":"2026-08-11T10:13:02.527Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53429b41e63e8d702e05f17b0f3af566","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.594Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-dffd42fef67482d0c3e06d40: done: 0.21713 sec","job_status":"done","queue_duration_s":0.003604,"scheduling_latency_s":0.003666,"redis_calls":17,"redis_duration_s":0.046147,"redis_read_bytes":1031,"redis_write_bytes":1616,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.021748,"redis_feature_flag_read_bytes":1024,"redis_feature_flag_write_bytes":544,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.019992,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004407,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.079,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.079,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00447322,"exclusive_lock_hold_duration_s":0.08765442,"duration_s":0.21713,"completed_at":"2026-08-11T10:13:02.815Z","load_balancing_strategy":"primary","db_duration_s":0.095109,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.041432] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:02.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d51e3332136d14b3c948e33e","created_at":"2026-08-11T10:13:02.610Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9c40483a8e0cb23439fd30b70de0ea4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:13:02.625Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d51e3332136d14b3c948e33e: start","job_status":"start","queue_duration_s":0.207889,"scheduling_latency_s":0.207942} gitlab # [ 314.092810] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:02.946Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d51e3332136d14b3c948e33e","created_at":"2026-08-11T10:13:02.610Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9c40483a8e0cb23439fd30b70de0ea4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:13:02.625Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d51e3332136d14b3c948e33e: done: 0.112748 sec","job_status":"done","queue_duration_s":0.207889,"scheduling_latency_s":0.207942,"redis_calls":9,"redis_duration_s":0.053617,"redis_read_bytes":261,"redis_write_bytes":906,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000388,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":165,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0037,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.049529,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.112748,"completed_at":"2026-08-11T10:13:02.946Z","load_balancing_strategy":"primary","db_duration_s":0.004922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.170037] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.011Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2ad0b1155915000ae08e08f7","created_at":"2026-08-11T10:13:02.632Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23882b074bf77fca64c66aa41253ec71","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.656Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2ad0b1155915000ae08e08f7: start","job_status":"start","queue_duration_s":0.355368,"scheduling_latency_s":0.355406} gitlab # [ 314.288621] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.142Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 314.319341] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2ad0b1155915000ae08e08f7","created_at":"2026-08-11T10:13:02.632Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23882b074bf77fca64c66aa41253ec71","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.656Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2ad0b1155915000ae08e08f7: done: 0.161242 sec","job_status":"done","queue_duration_s":0.355368,"scheduling_latency_s":0.355406,"redis_calls":8,"redis_duration_s":0.015443,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001158,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009808,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004477,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.161242,"completed_at":"2026-08-11T10:13:03.172Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.405244] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7058fde6e86d673b81bb686a","created_at":"2026-08-11T10:13:02.693Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6579e9084fb2a3588cd39d773d1e0424","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.701Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7058fde6e86d673b81bb686a: start","job_status":"start","queue_duration_s":0.474964,"scheduling_latency_s":0.474996} gitlab # [ 314.447208] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7058fde6e86d673b81bb686a","created_at":"2026-08-11T10:13:02.693Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6579e9084fb2a3588cd39d773d1e0424","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.701Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7058fde6e86d673b81bb686a: done: 0.123594 sec","job_status":"done","queue_duration_s":0.474964,"scheduling_latency_s":0.474996,"redis_calls":11,"redis_duration_s":0.003907,"redis_read_bytes":136,"redis_write_bytes":1339,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000224,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002089,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001594,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00880334,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.123594,"completed_at":"2026-08-11T10:13:03.299Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003015,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 314.535441] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7476d434d2bec65725fc3a9e","created_at":"2026-08-11T10:13:02.726Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a7991c869ae4977a3e3ed6dc9ae6f05","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.731Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7476d434d2bec65725fc3a9e: start","job_status":"start","queue_duration_s":0.573098,"scheduling_latency_s":0.573129} gitlab # [ 314.553271] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.370Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7476d434d2bec65725fc3a9e","created_at":"2026-08-11T10:13:02.726Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a7991c869ae4977a3e3ed6dc9ae6f05","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.731Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7476d434d2bec65725fc3a9e: done: 0.06631 sec","job_status":"done","queue_duration_s":0.573098,"scheduling_latency_s":0.573129,"redis_calls":10,"redis_duration_s":0.003803,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001912,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001642,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00095078,"exclusive_lock_hold_duration_s":0.0215931,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.06631,"completed_at":"2026-08-11T10:13:03.370Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.599067] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.373Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"968a6336a7703e9d92ac8fa9","created_at":"2026-08-11T10:13:02.744Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8525766f021eb55e68138a6af97cca9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:13:02.748Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-968a6336a7703e9d92ac8fa9: start","job_status":"start","queue_duration_s":0.625049,"scheduling_latency_s":0.625093} gitlab # [ 314.612836] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.393Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 314.616114] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"968a6336a7703e9d92ac8fa9","created_at":"2026-08-11T10:13:02.744Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8525766f021eb55e68138a6af97cca9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:13:02.748Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-968a6336a7703e9d92ac8fa9: done: 0.028473 sec","job_status":"done","queue_duration_s":0.625049,"scheduling_latency_s":0.625093,"redis_calls":8,"redis_duration_s":0.002499,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000636,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028473,"completed_at":"2026-08-11T10:13:03.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.657155] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.405Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"33ab8f20c8cf04b1e7c24cdf","created_at":"2026-08-11T10:13:02.774Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d75c56ea41ea9b7b44576d41189b668f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.780Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-33ab8f20c8cf04b1e7c24cdf: start","job_status":"start","queue_duration_s":0.624463,"scheduling_latency_s":0.62449} gitlab # [ 315.037872] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.890Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"33ab8f20c8cf04b1e7c24cdf","created_at":"2026-08-11T10:13:02.774Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d75c56ea41ea9b7b44576d41189b668f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.780Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-33ab8f20c8cf04b1e7c24cdf: done: 0.485661 sec","job_status":"done","queue_duration_s":0.624463,"scheduling_latency_s":0.62449,"redis_calls":563,"redis_duration_s":0.111984,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.110193,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.428872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.485661,"completed_at":"2026-08-11T10:13:03.890Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.130658] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.892Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0e649daf5278cebb55b60fdb","created_at":"2026-08-11T10:13:02.790Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.804Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0e649daf5278cebb55b60fdb: start","job_status":"start","queue_duration_s":1.087887,"scheduling_latency_s":1.087906} gitlab # [ 315.148693] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0e649daf5278cebb55b60fdb","created_at":"2026-08-11T10:13:02.790Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.804Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0e649daf5278cebb55b60fdb: done: 0.105992 sec","job_status":"done","queue_duration_s":1.087887,"scheduling_latency_s":1.087906,"redis_calls":65,"redis_duration_s":0.017256,"redis_read_bytes":748,"redis_write_bytes":41452,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.001546,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.001079,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013995,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000636,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.090983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.105992,"completed_at":"2026-08-11T10:13:03.998Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.193668] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:03.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f5786c59dedc63902af9e4aa","created_at":"2026-08-11T10:13:02.817Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c58c9be356af73e764d96f52bcbbb280","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:13:02.831Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f5786c59dedc63902af9e4aa: start","job_status":"start","queue_duration_s":1.16758,"scheduling_latency_s":1.167597} gitlab # [ 315.207019] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.008Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 315.210888] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.014Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f5786c59dedc63902af9e4aa","created_at":"2026-08-11T10:13:02.817Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c58c9be356af73e764d96f52bcbbb280","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:13:02.831Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f5786c59dedc63902af9e4aa: done: 0.0146 sec","job_status":"done","queue_duration_s":1.16758,"scheduling_latency_s":1.167597,"redis_calls":8,"redis_duration_s":0.001284,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000154,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00033,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0146,"completed_at":"2026-08-11T10:13:04.014Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.251978] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.015Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"fa3a155ddf1267752072f7be","created_at":"2026-08-11T10:13:02.914Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8cdcd179b2d6d72272b67871ccb260f0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.921Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-fa3a155ddf1267752072f7be: start","job_status":"start","queue_duration_s":1.093639,"scheduling_latency_s":1.093656} gitlab # [ 315.266531] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.023Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 315.269996] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.028Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"fa3a155ddf1267752072f7be","created_at":"2026-08-11T10:13:02.914Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8cdcd179b2d6d72272b67871ccb260f0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.921Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-fa3a155ddf1267752072f7be: done: 0.013251 sec","job_status":"done","queue_duration_s":1.093639,"scheduling_latency_s":1.093656,"redis_calls":8,"redis_duration_s":0.001101,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000129,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013251,"completed_at":"2026-08-11T10:13:04.028Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.313182] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.030Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"8987817bf2c99edad495748d","created_at":"2026-08-11T10:13:02.938Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae64870614fdcae77857438696be8056","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.942Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-8987817bf2c99edad495748d: start","job_status":"start","queue_duration_s":1.087872,"scheduling_latency_s":1.087895} gitlab # [ 315.327767] postgres[3299]: [3299] ERROR: relation "table_without_models" does not exist gitlab # [ 315.328961] postgres[3299]: [3299] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 315.330213] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.050Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"8987817bf2c99edad495748d","created_at":"2026-08-11T10:13:02.938Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae64870614fdcae77857438696be8056","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.942Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-8987817bf2c99edad495748d: done: 0.020996 sec","job_status":"done","queue_duration_s":1.087872,"scheduling_latency_s":1.087895,"redis_calls":9,"redis_duration_s":0.001245,"redis_read_bytes":261,"redis_write_bytes":944,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":168,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000723,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020996,"completed_at":"2026-08-11T10:13:04.050Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.372149] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.051Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"84070478848ddf12b6048bef","created_at":"2026-08-11T10:13:02.975Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba7ae7115b0aa218d62e116fd3492513","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.982Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-84070478848ddf12b6048bef: start","job_status":"start","queue_duration_s":1.069717,"scheduling_latency_s":1.069734} gitlab # [ 315.386509] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.059Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 315.390178] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.065Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"84070478848ddf12b6048bef","created_at":"2026-08-11T10:13:02.975Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba7ae7115b0aa218d62e116fd3492513","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.982Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-84070478848ddf12b6048bef: done: 0.013965 sec","job_status":"done","queue_duration_s":1.069717,"scheduling_latency_s":1.069734,"redis_calls":8,"redis_duration_s":0.001288,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000143,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013965,"completed_at":"2026-08-11T10:13:04.065Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.432660] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c18a1cae08a2460fed12eac1","created_at":"2026-08-11T10:13:02.990Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba8d73b14fc8b7a6136c063ee636753b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.998Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c18a1cae08a2460fed12eac1: start","job_status":"start","queue_duration_s":1.068725,"scheduling_latency_s":1.068742} gitlab # [ 315.447749] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c18a1cae08a2460fed12eac1","created_at":"2026-08-11T10:13:02.990Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba8d73b14fc8b7a6136c063ee636753b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:02.998Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c18a1cae08a2460fed12eac1: done: 0.234764 sec","job_status":"done","queue_duration_s":1.068725,"scheduling_latency_s":1.068742,"redis_calls":11,"redis_duration_s":0.001658,"redis_read_bytes":263,"redis_write_bytes":1138,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":151,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00066,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.031,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.19264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047362,"exclusive_lock_hold_duration_s":0.21953982,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.234764,"completed_at":"2026-08-11T10:13:04.301Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.05701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.493914] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.303Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"96a0449bd2ec7c6f7dc10cc6","created_at":"2026-08-11T10:13:03.011Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f88b30b3342f7aa507c09836eedff88","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.016Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-96a0449bd2ec7c6f7dc10cc6: start","job_status":"start","queue_duration_s":1.286219,"scheduling_latency_s":1.286237} gitlab # [ 315.508533] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.333Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"96a0449bd2ec7c6f7dc10cc6","created_at":"2026-08-11T10:13:03.011Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f88b30b3342f7aa507c09836eedff88","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.016Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-96a0449bd2ec7c6f7dc10cc6: done: 0.030703 sec","job_status":"done","queue_duration_s":1.286219,"scheduling_latency_s":1.286237,"redis_calls":10,"redis_duration_s":0.001595,"redis_read_bytes":135,"redis_write_bytes":1267,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000142,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":105,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000685,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056776,"exclusive_lock_hold_duration_s":0.01576342,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.030703,"completed_at":"2026-08-11T10:13:04.333Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.552957] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"794de65cf69bd8b2caf3e342","created_at":"2026-08-11T10:13:03.032Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af1c8d0d9db5662da8c5453377a5e4c5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.037Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-794de65cf69bd8b2caf3e342: start","job_status":"start","queue_duration_s":1.297169,"scheduling_latency_s":1.297187} gitlab # [ 315.568507] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.348Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"794de65cf69bd8b2caf3e342","created_at":"2026-08-11T10:13:03.032Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af1c8d0d9db5662da8c5453377a5e4c5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.037Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-794de65cf69bd8b2caf3e342: done: 0.01349 sec","job_status":"done","queue_duration_s":1.297169,"scheduling_latency_s":1.297187,"redis_calls":8,"redis_duration_s":0.0011220000000000002,"redis_read_bytes":133,"redis_write_bytes":943,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00012,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":112,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01349,"completed_at":"2026-08-11T10:13:04.348Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.611412] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.349Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"019867b75b926a4bf53f92ea","created_at":"2026-08-11T10:13:03.045Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2f605f5460415d282474345db1db257","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.052Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-019867b75b926a4bf53f92ea: start","job_status":"start","queue_duration_s":1.29792,"scheduling_latency_s":1.297936} gitlab # [ 315.625968] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.366Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"019867b75b926a4bf53f92ea","created_at":"2026-08-11T10:13:03.045Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2f605f5460415d282474345db1db257","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.052Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-019867b75b926a4bf53f92ea: done: 0.016401 sec","job_status":"done","queue_duration_s":1.29792,"scheduling_latency_s":1.297936,"redis_calls":10,"redis_duration_s":0.001662,"redis_read_bytes":135,"redis_write_bytes":1184,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000123,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":97,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00071,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047142,"exclusive_lock_hold_duration_s":0.00263422,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.016401,"completed_at":"2026-08-11T10:13:04.366Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.669011] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.367Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d9827feff8a8daf4fb4bd052","created_at":"2026-08-11T10:13:03.093Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b88339b00e060e98c1c27848caf4064","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.098Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d9827feff8a8daf4fb4bd052: start","job_status":"start","queue_duration_s":1.269279,"scheduling_latency_s":1.269295} gitlab # [ 315.684002] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.375Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 315.687739] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.380Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d9827feff8a8daf4fb4bd052","created_at":"2026-08-11T10:13:03.093Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b88339b00e060e98c1c27848caf4064","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.098Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d9827feff8a8daf4fb4bd052: done: 0.013061 sec","job_status":"done","queue_duration_s":1.269279,"scheduling_latency_s":1.269295,"redis_calls":8,"redis_duration_s":0.001122,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000126,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013061,"completed_at":"2026-08-11T10:13:04.380Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.731897] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.381Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"911c7f7594ce540a32ededc8","created_at":"2026-08-11T10:13:03.113Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca794e3f473abfe3ff06b8b2222cbf26","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.130Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-911c7f7594ce540a32ededc8: start","job_status":"start","queue_duration_s":1.251567,"scheduling_latency_s":1.251584} gitlab # [ 315.745227] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.410Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"911c7f7594ce540a32ededc8","created_at":"2026-08-11T10:13:03.113Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca794e3f473abfe3ff06b8b2222cbf26","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.130Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-911c7f7594ce540a32ededc8: done: 0.029053 sec","job_status":"done","queue_duration_s":1.251567,"scheduling_latency_s":1.251584,"redis_calls":12,"redis_duration_s":0.00186,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000325,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000692,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047174,"exclusive_lock_hold_duration_s":0.01138494,"duration_s":0.029053,"completed_at":"2026-08-11T10:13:04.410Z","load_balancing_strategy":"primary","db_duration_s":0.004303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.786271] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.412Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b34d93241fce4eac8b39caf8","created_at":"2026-08-11T10:13:03.150Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e163cf611edecf1b62f219d7c9067a3","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.160Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b34d93241fce4eac8b39caf8: start","job_status":"start","queue_duration_s":1.251807,"scheduling_latency_s":1.251824} gitlab # [ 315.800493] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.445Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b34d93241fce4eac8b39caf8","created_at":"2026-08-11T10:13:03.150Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e163cf611edecf1b62f219d7c9067a3","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.160Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b34d93241fce4eac8b39caf8: done: 0.033227 sec","job_status":"done","queue_duration_s":1.251807,"scheduling_latency_s":1.251824,"redis_calls":11,"redis_duration_s":0.00247,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000953,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033227,"completed_at":"2026-08-11T10:13:04.445Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003152,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.842285] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.448Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"92ec7da87379f98f214f5773","created_at":"2026-08-11T10:13:03.174Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9aca9bff5eff60bf10706602a9eddef4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.185Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-92ec7da87379f98f214f5773: start","job_status":"start","queue_duration_s":1.263316,"scheduling_latency_s":1.263359} gitlab # [ 315.856444] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.493Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"92ec7da87379f98f214f5773","created_at":"2026-08-11T10:13:03.174Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9aca9bff5eff60bf10706602a9eddef4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.185Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-92ec7da87379f98f214f5773: done: 0.044848 sec","job_status":"done","queue_duration_s":1.263316,"scheduling_latency_s":1.263359,"redis_calls":8,"redis_duration_s":0.002809,"redis_read_bytes":133,"redis_write_bytes":936,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000709,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.044848,"completed_at":"2026-08-11T10:13:04.493Z","load_balancing_strategy":"primary","db_duration_s":0.009315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.900217] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"f8c4795544b3c05417818bc5","created_at":"2026-08-11T10:13:03.191Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"440324ab8ae9ebac21ed50b5bd2c8493","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.203Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-f8c4795544b3c05417818bc5: start","job_status":"start","queue_duration_s":1.293889,"scheduling_latency_s":1.293928} gitlab # [ 315.914034] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.529Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"f8c4795544b3c05417818bc5","created_at":"2026-08-11T10:13:03.191Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"440324ab8ae9ebac21ed50b5bd2c8493","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.203Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-f8c4795544b3c05417818bc5: done: 0.032495 sec","job_status":"done","queue_duration_s":1.293889,"scheduling_latency_s":1.293928,"redis_calls":8,"redis_duration_s":0.002796,"redis_read_bytes":133,"redis_write_bytes":764,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000294,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001788,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000714,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032495,"completed_at":"2026-08-11T10:13:04.529Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.956879] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5e26f39d213d670a03ca4e0a","created_at":"2026-08-11T10:13:03.211Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86307be0afac964c3c33e82474c83076","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.217Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5e26f39d213d670a03ca4e0a: start","job_status":"start","queue_duration_s":1.314674,"scheduling_latency_s":1.314704} gitlab # [ 315.970509] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.576Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5e26f39d213d670a03ca4e0a","created_at":"2026-08-11T10:13:03.211Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-da059773c28a46e5","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86307be0afac964c3c33e82474c83076","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.217Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5e26f39d213d670a03ca4e0a: done: 0.044416 sec","job_status":"done","queue_duration_s":1.314674,"scheduling_latency_s":1.314704,"redis_calls":16,"redis_duration_s":0.004861,"redis_read_bytes":272,"redis_write_bytes":4229,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000572,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":199,"redis_queues_calls":2,"redis_queues_duration_s":0.0005,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002762,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044416,"completed_at":"2026-08-11T10:13:04.576Z","load_balancing_strategy":"primary","db_duration_s":0.002049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.013679] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8ce83b2d41f7ac09fc4d7bb","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8ce83b2d41f7ac09fc4d7bb: start","job_status":"start","queue_duration_s":0.587791,"scheduling_latency_s":0.587816} gitlab # [ 316.026174] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8ce83b2d41f7ac09fc4d7bb","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8ce83b2d41f7ac09fc4d7bb: done: 0.023624 sec","job_status":"done","queue_duration_s":0.587791,"scheduling_latency_s":0.587816,"redis_calls":14,"redis_duration_s":0.003738,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001124,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002344,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023624,"completed_at":"2026-08-11T10:13:04.601Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.067616] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31a7aa52ba975ff572c530f1","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31a7aa52ba975ff572c530f1: start","job_status":"start","queue_duration_s":0.613139,"scheduling_latency_s":0.613158} gitlab # [ 316.080469] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31a7aa52ba975ff572c530f1","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31a7aa52ba975ff572c530f1: done: 0.019042 sec","job_status":"done","queue_duration_s":0.613139,"scheduling_latency_s":0.613158,"redis_calls":13,"redis_duration_s":0.003351,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002349,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019042,"completed_at":"2026-08-11T10:13:04.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.120851] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"164cb9fc82a9c0e7079f5e75","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-164cb9fc82a9c0e7079f5e75: start","job_status":"start","queue_duration_s":0.634099,"scheduling_latency_s":0.634118} gitlab # [ 316.133170] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"164cb9fc82a9c0e7079f5e75","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-164cb9fc82a9c0e7079f5e75: done: 0.017526 sec","job_status":"done","queue_duration_s":0.634099,"scheduling_latency_s":0.634118,"redis_calls":13,"redis_duration_s":0.002872,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000997,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001875,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017526,"completed_at":"2026-08-11T10:13:04.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.173229] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de6cfa73d96a19e7c012f51a","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de6cfa73d96a19e7c012f51a: start","job_status":"start","queue_duration_s":0.653212,"scheduling_latency_s":0.653229} gitlab # [ 316.185737] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de6cfa73d96a19e7c012f51a","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de6cfa73d96a19e7c012f51a: done: 0.016701 sec","job_status":"done","queue_duration_s":0.653212,"scheduling_latency_s":0.653229,"redis_calls":13,"redis_duration_s":0.002974,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016701,"completed_at":"2026-08-11T10:13:04.660Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.225378] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b970c369dd792f3140740a8b","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b970c369dd792f3140740a8b: start","job_status":"start","queue_duration_s":0.671255,"scheduling_latency_s":0.671272} gitlab # [ 316.237616] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b970c369dd792f3140740a8b","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b970c369dd792f3140740a8b: done: 0.015873 sec","job_status":"done","queue_duration_s":0.671255,"scheduling_latency_s":0.671272,"redis_calls":13,"redis_duration_s":0.00304,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015873,"completed_at":"2026-08-11T10:13:04.677Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.277010] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12f5f5e566aa6175790ad258","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12f5f5e566aa6175790ad258: start","job_status":"start","queue_duration_s":0.688504,"scheduling_latency_s":0.68852} gitlab # [ 316.289077] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12f5f5e566aa6175790ad258","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12f5f5e566aa6175790ad258: done: 0.015401 sec","job_status":"done","queue_duration_s":0.688504,"scheduling_latency_s":0.68852,"redis_calls":13,"redis_duration_s":0.00281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001821,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015401,"completed_at":"2026-08-11T10:13:04.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.328895] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28d9ca918270a582318bf0d5","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28d9ca918270a582318bf0d5: start","job_status":"start","queue_duration_s":0.705333,"scheduling_latency_s":0.705349} gitlab # [ 316.341266] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28d9ca918270a582318bf0d5","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28d9ca918270a582318bf0d5: done: 0.015251 sec","job_status":"done","queue_duration_s":0.705333,"scheduling_latency_s":0.705349,"redis_calls":13,"redis_duration_s":0.002806,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015251,"completed_at":"2026-08-11T10:13:04.711Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.380100] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"945aa6292669dee07f1a5fd3","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-945aa6292669dee07f1a5fd3: start","job_status":"start","queue_duration_s":0.722,"scheduling_latency_s":0.722017} gitlab # [ 316.392540] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"945aa6292669dee07f1a5fd3","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-945aa6292669dee07f1a5fd3: done: 0.020357 sec","job_status":"done","queue_duration_s":0.722,"scheduling_latency_s":0.722017,"redis_calls":13,"redis_duration_s":0.003118,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001187,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020357,"completed_at":"2026-08-11T10:13:04.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.431716] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f08b09418b7d873a1d2030f9","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f08b09418b7d873a1d2030f9: start","job_status":"start","queue_duration_s":0.74559,"scheduling_latency_s":0.745633} gitlab # [ 316.444236] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f08b09418b7d873a1d2030f9","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f08b09418b7d873a1d2030f9: done: 0.037407 sec","job_status":"done","queue_duration_s":0.74559,"scheduling_latency_s":0.745633,"redis_calls":13,"redis_duration_s":0.003966,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002344,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037407,"completed_at":"2026-08-11T10:13:04.773Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.483858] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"262ac8e9708281ef78997168","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-262ac8e9708281ef78997168: start","job_status":"start","queue_duration_s":0.785595,"scheduling_latency_s":0.785629} gitlab # [ 316.496563] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"262ac8e9708281ef78997168","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-262ac8e9708281ef78997168: done: 0.031546 sec","job_status":"done","queue_duration_s":0.785595,"scheduling_latency_s":0.785629,"redis_calls":13,"redis_duration_s":0.003769,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001324,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002445,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031546,"completed_at":"2026-08-11T10:13:04.807Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.537084] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0345ea4228577be92e2a737","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0345ea4228577be92e2a737: start","job_status":"start","queue_duration_s":0.819323,"scheduling_latency_s":0.819352} gitlab # [ 316.549559] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0345ea4228577be92e2a737","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0345ea4228577be92e2a737: done: 0.025576 sec","job_status":"done","queue_duration_s":0.819323,"scheduling_latency_s":0.819352,"redis_calls":13,"redis_duration_s":0.002768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025576,"completed_at":"2026-08-11T10:13:04.835Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.588579] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70f59bfa3b8bbf8bc99f2ef3","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70f59bfa3b8bbf8bc99f2ef3: start","job_status":"start","queue_duration_s":0.846383,"scheduling_latency_s":0.846407} gitlab # [ 316.601097] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70f59bfa3b8bbf8bc99f2ef3","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70f59bfa3b8bbf8bc99f2ef3: done: 0.020803 sec","job_status":"done","queue_duration_s":0.846383,"scheduling_latency_s":0.846407,"redis_calls":13,"redis_duration_s":0.002045,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000738,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001307,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020803,"completed_at":"2026-08-11T10:13:04.857Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.640768] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"744768492c77b6be85e36d85","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-744768492c77b6be85e36d85: start","job_status":"start","queue_duration_s":0.868589,"scheduling_latency_s":0.868609} gitlab # [ 316.653650] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"744768492c77b6be85e36d85","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-744768492c77b6be85e36d85: done: 0.017706 sec","job_status":"done","queue_duration_s":0.868589,"scheduling_latency_s":0.868609,"redis_calls":13,"redis_duration_s":0.0019529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000649,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001304,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017706,"completed_at":"2026-08-11T10:13:04.876Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.693720] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c53f41952cac3c2ea5858509","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c53f41952cac3c2ea5858509: start","job_status":"start","queue_duration_s":0.887642,"scheduling_latency_s":0.88766} gitlab # [ 316.706585] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c53f41952cac3c2ea5858509","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c53f41952cac3c2ea5858509: done: 0.018167 sec","job_status":"done","queue_duration_s":0.887642,"scheduling_latency_s":0.88766,"redis_calls":13,"redis_duration_s":0.00195,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000692,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001258,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018167,"completed_at":"2026-08-11T10:13:04.896Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.747510] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64ee880c5a1a99c4247b5ecd","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64ee880c5a1a99c4247b5ecd: start","job_status":"start","queue_duration_s":0.907051,"scheduling_latency_s":0.90707} gitlab # [ 316.760505] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64ee880c5a1a99c4247b5ecd","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64ee880c5a1a99c4247b5ecd: done: 0.016609 sec","job_status":"done","queue_duration_s":0.907051,"scheduling_latency_s":0.90707,"redis_calls":13,"redis_duration_s":0.001663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016609,"completed_at":"2026-08-11T10:13:04.914Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.800851] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc2322ad4eb497f954d42f2c","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc2322ad4eb497f954d42f2c: start","job_status":"start","queue_duration_s":0.924886,"scheduling_latency_s":0.924904} gitlab # [ 316.813425] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc2322ad4eb497f954d42f2c","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc2322ad4eb497f954d42f2c: done: 0.015999 sec","job_status":"done","queue_duration_s":0.924886,"scheduling_latency_s":0.924904,"redis_calls":13,"redis_duration_s":0.00199,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001418,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015999,"completed_at":"2026-08-11T10:13:04.931Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.853748] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db9b011a3d72143149bbeabc","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db9b011a3d72143149bbeabc: start","job_status":"start","queue_duration_s":0.942132,"scheduling_latency_s":0.942152} gitlab # [ 316.891112] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db9b011a3d72143149bbeabc","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db9b011a3d72143149bbeabc: done: 0.014787 sec","job_status":"done","queue_duration_s":0.942132,"scheduling_latency_s":0.942152,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014787,"completed_at":"2026-08-11T10:13:04.947Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.963945] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b57ce8e615cc253d34351663","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b57ce8e615cc253d34351663: start","job_status":"start","queue_duration_s":0.957985,"scheduling_latency_s":0.958002} gitlab # [ 316.984415] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b57ce8e615cc253d34351663","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b57ce8e615cc253d34351663: done: 0.015287 sec","job_status":"done","queue_duration_s":0.957985,"scheduling_latency_s":0.958002,"redis_calls":13,"redis_duration_s":0.001528,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015287,"completed_at":"2026-08-11T10:13:04.963Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.036504] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b16f6549e2d533bd6533ef0","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b16f6549e2d533bd6533ef0: start","job_status":"start","queue_duration_s":0.974438,"scheduling_latency_s":0.974453} gitlab # [ 317.050580] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b16f6549e2d533bd6533ef0","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b16f6549e2d533bd6533ef0: done: 0.027606 sec","job_status":"done","queue_duration_s":0.974438,"scheduling_latency_s":0.974453,"redis_calls":13,"redis_duration_s":0.001751,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001152,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027606,"completed_at":"2026-08-11T10:13:04.992Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.091891] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:04.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36b5ffd852166552c45c790e","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36b5ffd852166552c45c790e: start","job_status":"start","queue_duration_s":1.003179,"scheduling_latency_s":1.003196} gitlab # [ 317.104784] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36b5ffd852166552c45c790e","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36b5ffd852166552c45c790e: done: 0.014338 sec","job_status":"done","queue_duration_s":1.003179,"scheduling_latency_s":1.003196,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014338,"completed_at":"2026-08-11T10:13:05.008Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.145201] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59f49adcc4be768fd3575062","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59f49adcc4be768fd3575062: start","job_status":"start","queue_duration_s":1.018623,"scheduling_latency_s":1.018639} gitlab # [ 317.157757] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59f49adcc4be768fd3575062","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59f49adcc4be768fd3575062: done: 0.014767 sec","job_status":"done","queue_duration_s":1.018623,"scheduling_latency_s":1.018639,"redis_calls":13,"redis_duration_s":0.0018189999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001233,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014767,"completed_at":"2026-08-11T10:13:05.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.197715] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaf3d0f8929dbfa508e11d5b","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaf3d0f8929dbfa508e11d5b: start","job_status":"start","queue_duration_s":1.034503,"scheduling_latency_s":1.034519} gitlab # [ 317.210171] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaf3d0f8929dbfa508e11d5b","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaf3d0f8929dbfa508e11d5b: done: 0.014391 sec","job_status":"done","queue_duration_s":1.034503,"scheduling_latency_s":1.034519,"redis_calls":13,"redis_duration_s":0.001515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014391,"completed_at":"2026-08-11T10:13:05.039Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.250130] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a517020da21fb93f0f89e5d","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a517020da21fb93f0f89e5d: start","job_status":"start","queue_duration_s":1.05,"scheduling_latency_s":1.050016} gitlab # [ 317.262673] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a517020da21fb93f0f89e5d","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a517020da21fb93f0f89e5d: done: 0.014123 sec","job_status":"done","queue_duration_s":1.05,"scheduling_latency_s":1.050016,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014123,"completed_at":"2026-08-11T10:13:05.054Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.302505] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3da5e3e944dd9e6873fea1ca","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3da5e3e944dd9e6873fea1ca: start","job_status":"start","queue_duration_s":1.06524,"scheduling_latency_s":1.065256} gitlab # [ 317.315316] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3da5e3e944dd9e6873fea1ca","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3da5e3e944dd9e6873fea1ca: done: 0.014288 sec","job_status":"done","queue_duration_s":1.06524,"scheduling_latency_s":1.065256,"redis_calls":13,"redis_duration_s":0.001556,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014288,"completed_at":"2026-08-11T10:13:05.070Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.356322] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"427d75c8c39bfad9761c1e85","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-427d75c8c39bfad9761c1e85: start","job_status":"start","queue_duration_s":1.080735,"scheduling_latency_s":1.080752} gitlab # [ 317.368725] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"427d75c8c39bfad9761c1e85","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-427d75c8c39bfad9761c1e85: done: 0.014111 sec","job_status":"done","queue_duration_s":1.080735,"scheduling_latency_s":1.080752,"redis_calls":13,"redis_duration_s":0.0015379999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014111,"completed_at":"2026-08-11T10:13:05.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.408756] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b02fe7d503b49dae8372d6b4","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b02fe7d503b49dae8372d6b4: start","job_status":"start","queue_duration_s":1.096013,"scheduling_latency_s":1.09603} gitlab # [ 317.421161] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b02fe7d503b49dae8372d6b4","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b02fe7d503b49dae8372d6b4: done: 0.018524 sec","job_status":"done","queue_duration_s":1.096013,"scheduling_latency_s":1.09603,"redis_calls":13,"redis_duration_s":0.001805,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018524,"completed_at":"2026-08-11T10:13:05.105Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.460528] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b94a274306851cfb215fa55","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b94a274306851cfb215fa55: start","job_status":"start","queue_duration_s":1.117965,"scheduling_latency_s":1.118007} gitlab # [ 317.475128] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b94a274306851cfb215fa55","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b94a274306851cfb215fa55: done: 0.022566 sec","job_status":"done","queue_duration_s":1.117965,"scheduling_latency_s":1.118007,"redis_calls":13,"redis_duration_s":0.00187,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022566,"completed_at":"2026-08-11T10:13:05.130Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.537888] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"408cbf62b9bfe61d1cc4e0e6","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-408cbf62b9bfe61d1cc4e0e6: start","job_status":"start","queue_duration_s":1.141618,"scheduling_latency_s":1.141637} gitlab # [ 317.562157] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"408cbf62b9bfe61d1cc4e0e6","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-408cbf62b9bfe61d1cc4e0e6: done: 0.014733 sec","job_status":"done","queue_duration_s":1.141618,"scheduling_latency_s":1.141637,"redis_calls":13,"redis_duration_s":0.001542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014733,"completed_at":"2026-08-11T10:13:05.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.617628] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e449fc64a7101809f906c522","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e449fc64a7101809f906c522: start","job_status":"start","queue_duration_s":1.157718,"scheduling_latency_s":1.15774} gitlab # [ 317.630899] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e449fc64a7101809f906c522","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e449fc64a7101809f906c522: done: 0.014785 sec","job_status":"done","queue_duration_s":1.157718,"scheduling_latency_s":1.15774,"redis_calls":13,"redis_duration_s":0.0015630000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014785,"completed_at":"2026-08-11T10:13:05.163Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.670104] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2495722af10d441d972e722d","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2495722af10d441d972e722d: start","job_status":"start","queue_duration_s":1.1736,"scheduling_latency_s":1.173616} gitlab # [ 317.682612] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2495722af10d441d972e722d","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2495722af10d441d972e722d: done: 0.014146 sec","job_status":"done","queue_duration_s":1.1736,"scheduling_latency_s":1.173616,"redis_calls":13,"redis_duration_s":0.001537,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014146,"completed_at":"2026-08-11T10:13:05.178Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.721431] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6d4fdf3d5a37045682d4ef1","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6d4fdf3d5a37045682d4ef1: start","job_status":"start","queue_duration_s":1.188909,"scheduling_latency_s":1.188926} gitlab # [ 317.733806] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6d4fdf3d5a37045682d4ef1","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6d4fdf3d5a37045682d4ef1: done: 0.014549 sec","job_status":"done","queue_duration_s":1.188909,"scheduling_latency_s":1.188926,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014549,"completed_at":"2026-08-11T10:13:05.194Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.773909] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc0d11446880ef70e0342375","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc0d11446880ef70e0342375: start","job_status":"start","queue_duration_s":1.204923,"scheduling_latency_s":1.204941} gitlab # [ 317.786456] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc0d11446880ef70e0342375","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc0d11446880ef70e0342375: done: 0.014259 sec","job_status":"done","queue_duration_s":1.204923,"scheduling_latency_s":1.204941,"redis_calls":13,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014259,"completed_at":"2026-08-11T10:13:05.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.826366] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6ecca970a8552035936e56f","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6ecca970a8552035936e56f: start","job_status":"start","queue_duration_s":1.220332,"scheduling_latency_s":1.220349} gitlab # [ 317.838702] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6ecca970a8552035936e56f","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6ecca970a8552035936e56f: done: 0.014435 sec","job_status":"done","queue_duration_s":1.220332,"scheduling_latency_s":1.220349,"redis_calls":13,"redis_duration_s":0.001518,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014435,"completed_at":"2026-08-11T10:13:05.225Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.878189] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8f4b89acafd00f638e481a3","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8f4b89acafd00f638e481a3: start","job_status":"start","queue_duration_s":1.235856,"scheduling_latency_s":1.235874} gitlab # [ 317.890686] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8f4b89acafd00f638e481a3","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8f4b89acafd00f638e481a3: done: 0.01434 sec","job_status":"done","queue_duration_s":1.235856,"scheduling_latency_s":1.235874,"redis_calls":13,"redis_duration_s":0.0015899999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01434,"completed_at":"2026-08-11T10:13:05.240Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.929760] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"446c61108219d935e99845fa","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-446c61108219d935e99845fa: start","job_status":"start","queue_duration_s":1.251292,"scheduling_latency_s":1.251309} gitlab # [ 317.942143] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"446c61108219d935e99845fa","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-446c61108219d935e99845fa: done: 0.0141 sec","job_status":"done","queue_duration_s":1.251292,"scheduling_latency_s":1.251309,"redis_calls":13,"redis_duration_s":0.001499,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0141,"completed_at":"2026-08-11T10:13:05.255Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 317.982411] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"037634d1ce5f8c93fcfb6545","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-037634d1ce5f8c93fcfb6545: start","job_status":"start","queue_duration_s":1.266478,"scheduling_latency_s":1.266494} gitlab # [ 317.995126] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"037634d1ce5f8c93fcfb6545","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-037634d1ce5f8c93fcfb6545: done: 0.014227 sec","job_status":"done","queue_duration_s":1.266478,"scheduling_latency_s":1.266494,"redis_calls":13,"redis_duration_s":0.001553,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014227,"completed_at":"2026-08-11T10:13:05.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.035165] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"076c0b2efc0363f89fd3881d","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-076c0b2efc0363f89fd3881d: start","job_status":"start","queue_duration_s":1.281828,"scheduling_latency_s":1.281845} gitlab # [ 318.047809] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"076c0b2efc0363f89fd3881d","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-076c0b2efc0363f89fd3881d: done: 0.014112 sec","job_status":"done","queue_duration_s":1.281828,"scheduling_latency_s":1.281845,"redis_calls":13,"redis_duration_s":0.0015019999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014112,"completed_at":"2026-08-11T10:13:05.286Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.087646] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d025ca79d55d730f6c229d7e","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d025ca79d55d730f6c229d7e: start","job_status":"start","queue_duration_s":1.297089,"scheduling_latency_s":1.297106} gitlab # [ 318.100704] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d025ca79d55d730f6c229d7e","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d025ca79d55d730f6c229d7e: done: 0.014155 sec","job_status":"done","queue_duration_s":1.297089,"scheduling_latency_s":1.297106,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014155,"completed_at":"2026-08-11T10:13:05.301Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.140503] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbde0de3d4efd21b4cd70158","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbde0de3d4efd21b4cd70158: start","job_status":"start","queue_duration_s":1.312412,"scheduling_latency_s":1.312428} gitlab # [ 318.152934] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbde0de3d4efd21b4cd70158","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbde0de3d4efd21b4cd70158: done: 0.014279 sec","job_status":"done","queue_duration_s":1.312412,"scheduling_latency_s":1.312428,"redis_calls":13,"redis_duration_s":0.0016129999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014279,"completed_at":"2026-08-11T10:13:05.317Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.193080] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3438bac0a8e3304e0b169c74","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3438bac0a8e3304e0b169c74: start","job_status":"start","queue_duration_s":1.328029,"scheduling_latency_s":1.328047} gitlab # [ 318.205916] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3438bac0a8e3304e0b169c74","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3438bac0a8e3304e0b169c74: done: 0.014013 sec","job_status":"done","queue_duration_s":1.328029,"scheduling_latency_s":1.328047,"redis_calls":13,"redis_duration_s":0.001469,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014013,"completed_at":"2026-08-11T10:13:05.332Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.245327] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e7e7b984540be897ddf618c","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e7e7b984540be897ddf618c: start","job_status":"start","queue_duration_s":1.343117,"scheduling_latency_s":1.343133} gitlab # [ 318.257800] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e7e7b984540be897ddf618c","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e7e7b984540be897ddf618c: done: 0.014203 sec","job_status":"done","queue_duration_s":1.343117,"scheduling_latency_s":1.343133,"redis_calls":13,"redis_duration_s":0.001515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014203,"completed_at":"2026-08-11T10:13:05.347Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.297736] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf15d013bcacef7b93d150b0","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf15d013bcacef7b93d150b0: start","job_status":"start","queue_duration_s":1.358457,"scheduling_latency_s":1.358474} gitlab # [ 318.310496] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf15d013bcacef7b93d150b0","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf15d013bcacef7b93d150b0: done: 0.014629 sec","job_status":"done","queue_duration_s":1.358457,"scheduling_latency_s":1.358474,"redis_calls":13,"redis_duration_s":0.001563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014629,"completed_at":"2026-08-11T10:13:05.363Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.350573] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f3a4a0c5d9e0c87badd4f19","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f3a4a0c5d9e0c87badd4f19: start","job_status":"start","queue_duration_s":1.374174,"scheduling_latency_s":1.374191} gitlab # [ 318.363900] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f3a4a0c5d9e0c87badd4f19","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f3a4a0c5d9e0c87badd4f19: done: 0.014229 sec","job_status":"done","queue_duration_s":1.374174,"scheduling_latency_s":1.374191,"redis_calls":13,"redis_duration_s":0.0015240000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014229,"completed_at":"2026-08-11T10:13:05.378Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.404277] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d905ef42bedffd7712f94e00","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d905ef42bedffd7712f94e00: start","job_status":"start","queue_duration_s":1.389509,"scheduling_latency_s":1.389524} gitlab # [ 318.416943] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d905ef42bedffd7712f94e00","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d905ef42bedffd7712f94e00: done: 0.014279 sec","job_status":"done","queue_duration_s":1.389509,"scheduling_latency_s":1.389524,"redis_calls":13,"redis_duration_s":0.001584,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014279,"completed_at":"2026-08-11T10:13:05.394Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.456643] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c74b63c36d18308873f37c81","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c74b63c36d18308873f37c81: start","job_status":"start","queue_duration_s":1.404995,"scheduling_latency_s":1.405012} gitlab # [ 318.468956] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c74b63c36d18308873f37c81","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c74b63c36d18308873f37c81: done: 0.014129 sec","job_status":"done","queue_duration_s":1.404995,"scheduling_latency_s":1.405012,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014129,"completed_at":"2026-08-11T10:13:05.409Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.507976] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64d458019e2986f246757493","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64d458019e2986f246757493: start","job_status":"start","queue_duration_s":1.420245,"scheduling_latency_s":1.420261} gitlab # [ 318.520526] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64d458019e2986f246757493","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64d458019e2986f246757493: done: 0.014629 sec","job_status":"done","queue_duration_s":1.420245,"scheduling_latency_s":1.420261,"redis_calls":13,"redis_duration_s":0.001909,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014629,"completed_at":"2026-08-11T10:13:05.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.559863] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81d8360b2ed6e076e042010d","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81d8360b2ed6e076e042010d: start","job_status":"start","queue_duration_s":1.435993,"scheduling_latency_s":1.436011} gitlab # [ 318.573428] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81d8360b2ed6e076e042010d","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81d8360b2ed6e076e042010d: done: 0.01622 sec","job_status":"done","queue_duration_s":1.435993,"scheduling_latency_s":1.436011,"redis_calls":13,"redis_duration_s":0.001622,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01622,"completed_at":"2026-08-11T10:13:05.442Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.612505] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a055dd18de2047ddeb922f11","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a055dd18de2047ddeb922f11: start","job_status":"start","queue_duration_s":1.453315,"scheduling_latency_s":1.453331} gitlab # [ 318.625183] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a055dd18de2047ddeb922f11","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a055dd18de2047ddeb922f11: done: 0.014095 sec","job_status":"done","queue_duration_s":1.453315,"scheduling_latency_s":1.453331,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014095,"completed_at":"2026-08-11T10:13:05.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.664792] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c0da6a09a9167e937039443","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c0da6a09a9167e937039443: start","job_status":"start","queue_duration_s":1.468537,"scheduling_latency_s":1.468553} gitlab # [ 318.677005] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c0da6a09a9167e937039443","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c0da6a09a9167e937039443: done: 0.0144 sec","job_status":"done","queue_duration_s":1.468537,"scheduling_latency_s":1.468553,"redis_calls":13,"redis_duration_s":0.001555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0144,"completed_at":"2026-08-11T10:13:05.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.716185] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"253458f3837dd741f8f83b52","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-253458f3837dd741f8f83b52: start","job_status":"start","queue_duration_s":1.48414,"scheduling_latency_s":1.484157} gitlab # [ 318.728631] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"253458f3837dd741f8f83b52","created_at":"2026-08-11T10:13:03.905Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-37530b4a5dc94783","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f4d4a12cb17b5b963bccf9ccff3ddb8a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:03.990Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-253458f3837dd741f8f83b52: done: 0.01429 sec","job_status":"done","queue_duration_s":1.48414,"scheduling_latency_s":1.484157,"redis_calls":13,"redis_duration_s":0.001538,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01429,"completed_at":"2026-08-11T10:13:05.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.768198] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.490Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c4b99021534c4043cf40c3c7","created_at":"2026-08-11T10:13:04.551Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-db9e2e11907c47f1","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"86307be0afac964c3c33e82474c83076","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:04.567Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c4b99021534c4043cf40c3c7: start","job_status":"start","queue_duration_s":0.922441,"scheduling_latency_s":0.922458} gitlab # [ 318.781657] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.501Z","message":"No existing merge request to be cleaned up."} gitlab # [ 318.783341] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.511Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c4b99021534c4043cf40c3c7","created_at":"2026-08-11T10:13:04.551Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-db9e2e11907c47f1","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"86307be0afac964c3c33e82474c83076","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:04.567Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c4b99021534c4043cf40c3c7: done: 0.021318 sec","job_status":"done","queue_duration_s":0.922441,"scheduling_latency_s":0.922458,"redis_calls":11,"redis_duration_s":0.001632,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000144,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000856,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021318,"completed_at":"2026-08-11T10:13:05.511Z","load_balancing_strategy":"primary","db_duration_s":0.002876,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.824119] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.512Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"faff90736633a5c974bd5852","created_at":"2026-08-11T10:13:04.551Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-db9e2e11907c47f1","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"86307be0afac964c3c33e82474c83076","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:04.567Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-faff90736633a5c974bd5852: start","job_status":"start","queue_duration_s":0.944879,"scheduling_latency_s":0.944896} gitlab # [ 318.836624] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.524Z","message":"No existing merge request to be cleaned up."} gitlab # [ 318.838313] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.541Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"faff90736633a5c974bd5852","created_at":"2026-08-11T10:13:04.551Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-db9e2e11907c47f1","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"86307be0afac964c3c33e82474c83076","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:04.567Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-faff90736633a5c974bd5852: done: 0.029127 sec","job_status":"done","queue_duration_s":0.944879,"scheduling_latency_s":0.944896,"redis_calls":10,"redis_duration_s":0.002033,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029127,"completed_at":"2026-08-11T10:13:05.541Z","load_balancing_strategy":"primary","db_duration_s":0.002809,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.877554] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.544Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e3a72f8b22b316facc8b1344","created_at":"2026-08-11T10:13:04.551Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-db9e2e11907c47f1","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"86307be0afac964c3c33e82474c83076","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:04.567Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e3a72f8b22b316facc8b1344: start","job_status":"start","queue_duration_s":0.97702,"scheduling_latency_s":0.977063} gitlab # [ 318.889718] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.568Z","message":"No existing merge request to be cleaned up."} gitlab # [ 318.891421] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.587Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e3a72f8b22b316facc8b1344","created_at":"2026-08-11T10:13:04.551Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-db9e2e11907c47f1","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"86307be0afac964c3c33e82474c83076","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:04.567Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e3a72f8b22b316facc8b1344: done: 0.043105 sec","job_status":"done","queue_duration_s":0.97702,"scheduling_latency_s":0.977063,"redis_calls":10,"redis_duration_s":0.0033890000000000005,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001306,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002083,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043105,"completed_at":"2026-08-11T10:13:05.587Z","load_balancing_strategy":"primary","db_duration_s":0.002509,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.930493] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.590Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cdb32d01b0adcb8ce1986ec2","created_at":"2026-08-11T10:13:04.551Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-db9e2e11907c47f1","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"86307be0afac964c3c33e82474c83076","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:04.567Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cdb32d01b0adcb8ce1986ec2: start","job_status":"start","queue_duration_s":1.022778,"scheduling_latency_s":1.022817} gitlab # [ 318.942859] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.611Z","message":"No existing merge request to be cleaned up."} gitlab # [ 318.944522] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:05.626Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cdb32d01b0adcb8ce1986ec2","created_at":"2026-08-11T10:13:04.551Z","trace_propagation_headers":{"sentry-trace":"9fef9ec7498d42f3bd7f1538756bf869-db9e2e11907c47f1","baggage":"sentry-trace_id=9fef9ec7498d42f3bd7f1538756bf869,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"86307be0afac964c3c33e82474c83076","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:04.567Z","job_size_bytes":2,"pid":2021,"sidekiq_tid":"maod","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cdb32d01b0adcb8ce1986ec2: done: 0.036457 sec","job_status":"done","queue_duration_s":1.022778,"scheduling_latency_s":1.022817,"redis_calls":10,"redis_duration_s":0.003686,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001324,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002362,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036457,"completed_at":"2026-08-11T10:13:05.626Z","load_balancing_strategy":"primary","db_duration_s":0.003079,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.687776] runuser[2971]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 320.689907] setup-gitlab-start[2944]: + systemctl restart gitlab-sidekiq.service gitlab # [ 320.728515] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 320.730104] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:09.584Z","message":"Shutting down"} gitlab # [ 320.731682] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:09.585Z","message":"Scheduler exiting..."} gitlab # [ 320.733398] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:09.585Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 320.735276] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:09.586Z","message":"Scheduler exiting..."} gitlab # [ 321.235653] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:10.089Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 322.239567] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:11.092Z","message":"Bye!"} gitlab # [ 322.283017] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-08-11T10:13:11.137Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2021,"worker_id":"sidekiq_0","memwd_rss_bytes":924909568,"retry":0} gitlab # [ 323.627727] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 323.628192] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 323.628375] systemd[1]: gitlab-sidekiq.service: Consumed 1min 51.481s CPU time over 3min 20.495s wall clock time, 947.2M memory peak, 5.6M read from disk. gitlab # [ 323.642115] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 323.646774] setup-gitlab-start[2944]: + mkdir -p /var/lib/secrets gitlab # [ 323.653112] setup-gitlab-start[2944]: + echo nixbot-test-token-of-20-chars gitlab # [ 323.656090] setup-gitlab-start[2944]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 323.659728] setup-gitlab-start[2944]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 324.967794] gitaly[922]: time="2026-08-11T10:13:13.820Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:13:23.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:13.820" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 324.968309] gitaly[922]: time="2026-08-11T10:13:13.821Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:13:23.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:13.820" grpc.time_ms=0.609 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.288966] gitaly[922]: time="2026-08-11T10:13:14.143Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:13:24.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.142" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.320637] gitaly[922]: time="2026-08-11T10:13:14.143Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:13:24.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.142" grpc.time_ms=0.587 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.413350] gitaly[922]: time="2026-08-11T10:13:14.267Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH diskcache=2d9ccb32-f290-429e-8151-0eeb11fdfb2c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:13:24.048" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.188" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.440620] gitaly[922]: time="2026-08-11T10:13:14.268Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=39 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=52 command.spawn_token_fork_ms=6 command.system_time_ms=36 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:13:24.048" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.188" grpc.time_ms=78.886 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.464837] gitaly[922]: time="2026-08-11T10:13:14.291Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:13:24.148" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.289" pid=922 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 325.480282] gitaly[922]: time="2026-08-11T10:13:14.292Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:13:24.148" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.289" grpc.time_ms=2.408 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.496530] gitaly[922]: time="2026-08-11T10:13:14.314Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:13:24.159" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.299" grpc.time_ms=14.383 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.568045] gitaly[922]: time="2026-08-11T10:13:14.422Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:13:24.281" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.421" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.592545] gitaly[922]: time="2026-08-11T10:13:14.423Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:13:24.281" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.421" grpc.time_ms=0.759 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.627265] gitaly[922]: time="2026-08-11T10:13:14.481Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH diskcache=931d3bb8-0004-4714-b9bd-d63c0e3a67a4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:13:24.285" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.425" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.650061] gitaly[922]: time="2026-08-11T10:13:14.482Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=36 command.spawn_token_fork_ms=5 command.system_time_ms=19 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T10:13:24.285" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.425" grpc.time_ms=56.127 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.673112] gitaly[922]: time="2026-08-11T10:13:14.490Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:13:24.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.489" pid=922 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 325.687386] gitaly[922]: time="2026-08-11T10:13:14.491Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:13:24.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.489" grpc.time_ms=1.496 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.701661] gitaly[922]: time="2026-08-11T10:13:14.511Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:13:24.015" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.495" grpc.time_ms=15.941 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.719205] gitaly[922]: time="2026-08-11T10:13:14.554Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:13:24.073" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.553" grpc.time_ms=0.304 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.734047] gitaly[922]: time="2026-08-11T10:13:14.565Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:13:24.083" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:14.564" grpc.time_ms=0.511 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 326.360859] gitaly[922]: time="2026-08-11T10:13:15.213Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZP6ZWYQ2EQNAJ6PSRJBH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:13:25.059" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:15.199" grpc.time_ms=14.041 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.100787] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:15 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 3409 gitlab # [ 327.105237] setup-gitlab-start[2944]: + mkdir -p /tmp/test-flake gitlab # [ 327.109891] setup-gitlab-start[2944]: + cd /tmp/test-flake gitlab # [ 327.112421] setup-gitlab-start[2944]: + git init -b master gitlab # [ 327.130070] setup-gitlab-start[3413]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 327.133756] setup-gitlab-start[2944]: + git config user.name test gitlab # [ 327.136379] setup-gitlab-start[2944]: + git config user.email test@example.com gitlab # [ 327.140243] setup-gitlab-start[2944]: + cat gitlab # [ 327.144255] setup-gitlab-start[2944]: + git add flake.nix gitlab # [ 327.150032] setup-gitlab-start[2944]: + git commit -m 'initial commit' gitlab # [ 327.166980] setup-gitlab-start[3418]: [master (root-commit) eb7e2f7] initial commit gitlab # [ 327.171594] setup-gitlab-start[3418]: 1 file changed, 10 insertions(+) gitlab # [ 327.174485] setup-gitlab-start[3418]: create mode 100644 flake.nix gitlab # [ 327.177291] setup-gitlab-start[2944]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 327.182102] setup-gitlab-start[2944]: + git push -u origin master gitlab # [ 327.530581] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:16 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 308 gitlab # [ 328.348438] gitaly[922]: time="2026-08-11T10:13:17.201Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=6 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZSZ2DG8QMVG6Y243GEC1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:17.180" grpc.time_ms=20.833 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 328.349650] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:17 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 816 gitlab # [ 328.777393] sidekiq-cluster[3360]: {"severity":"INFO","time":"2026-08-11T10:13:17.601Z","message":"Starting cluster with 1 processes"} gitlab # [ 328.857862] gitaly[922]: time="2026-08-11T10:13:17.712Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:13:27.217" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:17.698" grpc.time_ms=13.427 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 329.031587] gitaly[922]: time="2026-08-11T10:13:17.885Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=10 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-11T10:13:47.046" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-11T10:13:17.847" grpc.time_ms=37.913 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 329.206701] gitaly[922]: time="2026-08-11T10:13:18.060Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZR4ZTTC42HX6G61SCNTY17E duration_ms=490ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 329.311627] gitaly[922]: time="2026-08-11T10:13:18.163Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZR4ZTTC42HX6G61SCNTY17E duration_ms=100ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 329.322343] gitaly[922]: time="2026-08-11T10:13:18.165Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:13:17.568" grpc.time_ms=596.774 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 329.399300] gitaly[922]: time="2026-08-11T10:13:18.250Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:13:18.245" grpc.time_ms=4.465 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 329.548876] gitaly[922]: time="2026-08-11T10:13:18.402Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:13:18.390" grpc.time_ms=8.634 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 329.598780] gitaly[922]: time="2026-08-11T10:13:18.452Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:13:18.452" grpc.time_ms=0.608 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 329.741767] gitaly[922]: time="2026-08-11T10:13:18.595Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:13:28.097" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:18.578" grpc.time_ms=17.178 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 329.794016] gitaly[922]: time="2026-08-11T10:13:18.648Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1431 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=4 command.system_time_ms=23 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-11T10:13:28.129" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:13:18.610" grpc.time_ms=37.516 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 329.829862] gitaly[922]: time="2026-08-11T10:13:18.668Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZR4ZTTC42HX6G61SCNTY17E duration_ms=165ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 329.837544] gitaly[922]: time="2026-08-11T10:13:18.669Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:13:18.502" grpc.time_ms=167.371 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 329.860214] gitaly[922]: time="2026-08-11T10:13:18.681Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E diskcache=5022c868-c5d7-4b58-8b35-d94b55687201 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:17.446" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 329.877794] gitlab-workhorse[816]: time="2026-08-11T10:13:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 329.880587] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:18 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1421 gitlab # [ 329.883651] systemd[1]: Finished setup-gitlab.service. gitlab # [ 329.884916] setup-gitlab-start[3422]: To http://gitlab/root/test-flake.git gitlab # [ 329.886153] setup-gitlab-start[3422]: * [new branch] master -> master gitlab # [ 329.887410] setup-gitlab-start[3422]: branch 'master' set up to track 'origin/master'. gitlab # [ 329.888885] gitaly[922]: time="2026-08-11T10:13:18.681Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=448 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13381 command.oublock=32 command.real_time_ms=1226 command.spawn_token_fork_ms=0 command.system_time_ms=246 command.user_time_ms=202 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:17.446" grpc.time_ms=1234.666 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 329.905688] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 331.34 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 331.032490] nixbot[3512]: {"ts": "2026-08-11T10:13:19.885Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 331.070415] nixbot[3512]: {"ts": "2026-08-11T10:13:19.924Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 331.109647] nixbot[3512]: {"ts": "2026-08-11T10:13:19.963Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 331.116890] nixbot[3512]: {"ts": "2026-08-11T10:13:19.971Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 331.124120] nixbot[3512]: {"ts": "2026-08-11T10:13:19.978Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 331.135907] nixbot[3512]: {"ts": "2026-08-11T10:13:19.990Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 331.142823] nixbot[3512]: {"ts": "2026-08-11T10:13:19.997Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 331.149428] nixbot[3512]: {"ts": "2026-08-11T10:13:20.000Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 331.158381] nixbot[3512]: {"ts": "2026-08-11T10:13:20.012Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 331.165101] nixbot[3512]: {"ts": "2026-08-11T10:13:20.016Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 331.171734] nixbot[3512]: {"ts": "2026-08-11T10:13:20.025Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 331.183885] nixbot[3512]: {"ts": "2026-08-11T10:13:20.038Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 331.190668] nixbot[3512]: {"ts": "2026-08-11T10:13:20.044Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 331.198379] nixbot[3512]: {"ts": "2026-08-11T10:13:20.048Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 331.205457] nixbot[3512]: {"ts": "2026-08-11T10:13:20.055Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 331.212331] nixbot[3512]: {"ts": "2026-08-11T10:13:20.060Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 331.218453] nixbot[3512]: {"ts": "2026-08-11T10:13:20.063Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 331.224712] nixbot[3512]: {"ts": "2026-08-11T10:13:20.066Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 331.230361] nixbot[3512]: {"ts": "2026-08-11T10:13:20.075Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 331.235928] nixbot[3512]: {"ts": "2026-08-11T10:13:20.078Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 331.241670] nixbot[3512]: {"ts": "2026-08-11T10:13:20.081Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 331.247083] nixbot[3512]: {"ts": "2026-08-11T10:13:20.091Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 331.253665] nixbot[3512]: {"ts": "2026-08-11T10:13:20.095Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 331.258936] nixbot[3512]: {"ts": "2026-08-11T10:13:20.099Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 331.263728] nixbot[3512]: {"ts": "2026-08-11T10:13:20.102Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 331.680401] nixbot[3512]: INFO: Started server process [3512] gitlab # [ 331.683142] nixbot[3512]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 331.701598] nixbot[3512]: INFO: ::ffff:127.0.0.1:57156 - "GET /health HTTP/1.1" 200 OK gitlab # [ 331.712169] systemd[1]: Started nixbot CI service. gitlab # [ 331.718943] systemd[1]: Reached target Multi-User System. gitlab # [ 331.719853] systemd[1]: Startup finished in 789ms (kernel) + 4.177s (initrd) + 5min 26.753s (userspace) = 5min 31.719s. gitlab: (finished: waiting for unit nixbot.service, in 1.11 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 332.061584] nixbot[3512]: INFO: ::ffff:127.0.0.1:47550 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 332.179573] nixbot[3512]: {"ts": "2026-08-11T10:13:21.031Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 332.193427] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:21 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 478 gitlab # [ 332.229934] nixbot[3512]: {"ts": "2026-08-11T10:13:21.084Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 332.286301] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 170 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.23 seconds) gitlab # [ 332.331192] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 89 gitlab # [ 332.333492] nixbot[3512]: {"ts": "2026-08-11T10:13:21.187Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 332.337307] nixbot[3512]: {"ts": "2026-08-11T10:13:21.191Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 332.470232] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 128 gitlab # [ 332.472522] nixbot[3512]: {"ts": "2026-08-11T10:13:21.326Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 333.441446] nixbot[3512]: {"ts": "2026-08-11T10:13:22.294Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 333.447393] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:22 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 952 gitlab # [ 333.467628] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 115 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds) (finished: subtest: project discovered and webhook registered, in 1.40 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 333.585350] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:22 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 50 gitlab # [ 333.610313] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 144 gitlab # [ 333.613495] nixbot[3512]: {"ts": "2026-08-11T10:13:22.467Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 333.743062] gitaly[922]: time="2026-08-11T10:13:22.595Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZZWCGWJVCCXDMPMDP1XT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:22.578" grpc.time_ms=17.014 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # Enumerating objects: 5, done. gitlab # [ 333.780281] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:22 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 151 gitlab # Counting objects: 20% (1/5)[ 333.785026] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:22 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 124 gitlab # Counting objects: 40% (2/5)[ 333.789547] nixbot[3512]: {"ts": "2026-08-11T10:13:22.635Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 91.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 333.900477] gitaly[922]: time="2026-08-11T10:13:22.754Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZR5002XH65HQKBC8TA43K5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-11T10:13:52.028" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:13:22.729" grpc.time_ms=24.932 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 333.948777] gitaly[922]: time="2026-08-11T10:13:22.802Z" level=info msg="finished unary call with code OK" catfile.duration_ms=8 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=8 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR5002XH65HQKBC8TA43K5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:13:52.092" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:13:22.793" grpc.time_ms=9.036 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 333.975086] gitaly[922]: time="2026-08-11T10:13:22.820Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR5002XH65HQKBC8TA43K5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-11T10:13:32.008" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:13:22.808" grpc.time_ms=11.028 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 333.996104] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 195 gitlab # [ 333.999080] nixbot[3512]: {"ts": "2026-08-11T10:13:22.851Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 334.079150] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 78 gitlab # [ 334.081862] nixbot[3512]: {"ts": "2026-08-11T10:13:22.935Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 334.088000] nixbot[3512]: {"ts": "2026-08-11T10:13:22.942Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 334.101724] gitaly[922]: time="2026-08-11T10:13:22.956Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-11T10:13:52.024" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-11T10:13:22.925" grpc.time_ms=30.856 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 334.130384] gitaly[922]: time="2026-08-11T10:13:22.984Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZR50038472JPBB18WAEY4D9 duration_ms=151ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 334.162170] gitaly[922]: time="2026-08-11T10:13:23.016Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZR50038472JPBB18WAEY4D9 duration_ms=31ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 334.165750] gitaly[922]: time="2026-08-11T10:13:23.020Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:13:22.832" grpc.time_ms=187.719 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 334.211730] gitaly[922]: time="2026-08-11T10:13:23.065Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:13:23.062" grpc.time_ms=2.271 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 334.227002] gitaly[922]: time="2026-08-11T10:13:23.081Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR500DZYWSB70PJA5XH0B5G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=196 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:23.063" grpc.time_ms=17.358 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 334.240918] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 74 gitlab # [ 334.268370] gitaly[922]: time="2026-08-11T10:13:23.122Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:13:23.121" grpc.time_ms=0.658 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 334.330225] gitaly[922]: time="2026-08-11T10:13:23.184Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:13:23.182" grpc.time_ms=1.516 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 334.369790] gitaly[922]: time="2026-08-11T10:13:23.224Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR500GFQN70ESZ4SW3HV6W3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:23.211" pid=922 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 334.386312] gitaly[922]: time="2026-08-11T10:13:23.239Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR500GFQN70ESZ4SW3HV6W3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:23.211" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 334.405606] gitaly[922]: time="2026-08-11T10:13:23.239Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR500GFQN70ESZ4SW3HV6W3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:23.211" grpc.time_ms=28.578 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 334.424300] gitlab-workhorse[816]: time="2026-08-11T10:13:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 334.426482] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 153 gitlab # [ 334.459365] gitaly[922]: time="2026-08-11T10:13:23.313Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZR50038472JPBB18WAEY4D9 duration_ms=72ns method=POST pid=922 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 334.464897] gitaly[922]: time="2026-08-11T10:13:23.314Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:13:23.239" grpc.time_ms=74.189 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 334.486383] gitaly[922]: time="2026-08-11T10:13:23.340Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 diskcache=988289da-4fb7-4aa9-9231-3e6890a4e3ea grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:22.760" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # To http://gitlab/root/test-flake.git gitlab # [ 334.498562] gitaly[922]: time="2026-08-11T10:13:23.341Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=226 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13431 command.oublock=32 command.real_time_ms=573 command.spawn_token_fork_ms=0 command.system_time_ms=121 command.user_time_ms=105 component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:22.760" grpc.time_ms=580.066 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # eb7e2f7..e1496f1 [ 334.514925] gitlab-workhorse[816]: time="2026-08-11T10:13:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # master -> master[ 334.517265] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:23 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 677 gitlab # gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.07 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 334.635672] gitaly[922]: time="2026-08-11T10:13:23.489Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR500PGMD3YHWH5G6GCTS03 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:23.459" pid=922 remote_ip="2001:db8:1::1" request_sha=bee54a2cf1fffffe9ae1d74457e3c8ca1456d1a6 response_bytes=418 span.kind=server system=grpc gitlab # [ 334.647553] gitaly[922]: time="2026-08-11T10:13:23.489Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1133 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=2 command.system_time_ms=19 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR500PGMD3YHWH5G6GCTS03 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:23.459" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 334.663279] gitlab-workhorse[816]: time="2026-08-11T10:13:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=418 gitlab # [ 334.665450] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 418 "" "git/2.55.0" 210 gitlab # [ 334.668062] nixbot[3512]: INFO: ::ffff:127.0.0.1:47554 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.11 seconds) gitlab # [ 334.670223] gitaly[922]: time="2026-08-11T10:13:23.490Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1133 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=2 command.system_time_ms=19 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR500PGMD3YHWH5G6GCTS03 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:23.459" grpc.time_ms=30.112 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 334.765679] gitaly[922]: time="2026-08-11T10:13:23.619Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR500Z2GPVVDSMM38V25SSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:23.608" grpc.time_ms=11.101 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 334.779357] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 65 gitlab # [ 334.845198] gitaly[922]: time="2026-08-11T10:13:23.698Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR501151EP4GN5WCFWF4X19 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:23.686" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 334.863598] gitaly[922]: time="2026-08-11T10:13:23.699Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR501151EP4GN5WCFWF4X19 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:23.686" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 334.882477] gitlab-workhorse[816]: time="2026-08-11T10:13:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 334.884845] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 78 gitlab # [ 334.887266] gitaly[922]: time="2026-08-11T10:13:23.699Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR501151EP4GN5WCFWF4X19 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:23.686" grpc.time_ms=13.326 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 334.977825] gitaly[922]: time="2026-08-11T10:13:23.832Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR5015GKA8RKKC96PVB8R3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:23.815" grpc.time_ms=16.774 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 335.013565] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 71 gitlab # [ 335.238302] gitaly[922]: time="2026-08-11T10:13:24.092Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR5017TMC0TRDHJNF8375HD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:24.059" pid=922 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 335.270759] gitaly[922]: time="2026-08-11T10:13:24.092Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01KZR5017TMC0TRDHJNF8375HD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:24.059" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 335.306963] gitlab-workhorse[816]: time="2026-08-11T10:13:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 335.311572] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 258 gitlab # [ 335.316112] gitaly[922]: time="2026-08-11T10:13:24.093Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01KZR5017TMC0TRDHJNF8375HD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:24.059" grpc.time_ms=33.629 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 335.391041] gitaly[922]: time="2026-08-11T10:13:24.245Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:13:54.043" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:13:24.244" grpc.time_ms=0.98 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 335.471454] gitaly[922]: time="2026-08-11T10:13:24.325Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-11T10:13:54.106" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:13:24.306" grpc.time_ms=18.715 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 335.520439] gitaly[922]: time="2026-08-11T10:13:24.374Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:13:34.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:13:24.358" grpc.time_ms=15.815 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 335.559635] gitaly[922]: time="2026-08-11T10:13:24.408Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:13:34.041" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:13:24.392" grpc.time_ms=15.731 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 335.718485] gitaly[922]: time="2026-08-11T10:13:24.572Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:13:34.219" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:24.571" grpc.time_ms=0.822 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 335.748319] nixbot[3512]: INFO: ::ffff:127.0.0.1:47562 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.08 seconds) gitlab # [ 335.771667] gitaly[922]: time="2026-08-11T10:13:24.624Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=8 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:13:34.250" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:13:24.602" grpc.time_ms=22.189 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 335.854473] gitaly[922]: time="2026-08-11T10:13:24.708Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:13:24.707" grpc.time_ms=0.808 pid=922 span.kind=server system=grpc gitlab # [ 335.907778] gitaly[922]: time="2026-08-11T10:13:24.762Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:13:24.760" grpc.time_ms=0.887 pid=922 span.kind=server system=grpc gitlab # [ 335.944641] gitaly[922]: time="2026-08-11T10:13:24.798Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 diskcache=4425552b-d401-4fe5-86e0-746d3a5734de grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:13:34.280" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:24.631" pid=922 ref=refs/keep-around/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 remote_ip="2001:db8:1::1" revision=eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 span.kind=server system=grpc username=root gitlab # [ 335.976076] gitaly[922]: time="2026-08-11T10:13:24.799Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=131 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5138 command.oublock=8 command.real_time_ms=158 command.spawn_token_fork_ms=2 command.system_time_ms=75 command.user_time_ms=56 component=gitaly.UnaryServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:13:34.280" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:13:24.631" grpc.time_ms=167.261 pid=922 ref=refs/keep-around/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 remote_ip="2001:db8:1::1" revision=eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 span.kind=server system=grpc username=root gitlab # [ 336.003142] gitaly[922]: time="2026-08-11T10:13:24.808Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:13:54.605" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:13:24.806" grpc.time_ms=1.685 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.309843] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 1007 gitlab # [ 336.318092] nixbot[3512]: {"ts": "2026-08-11T10:13:25.164Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 \"HTTP/1.1 201 Created\""} gitlab # [ 336.326828] nixbot[3512]: {"ts": "2026-08-11T10:13:25.180Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-eb7e2f7c1768-0"} gitlab # [ 336.444869] systemd[1]: Started Nix Daemon. gitlab # [ 336.561079] nix-daemon[3730]: accepted connection from pid 3724, user nixbot gitlab # [ 336.695227] nix-daemon[3730]: accepted connection from pid 3737, user nixbot gitlab # [ 336.721581] nixbot[3512]: {"ts": "2026-08-11T10:13:25.575Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-eb7e2f7c1768-0", "argv0": "bwrap"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab # [ 336.814668] nixbot[3512]: INFO: ::ffff:127.0.0.1:47570 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab # [ 336.942166] nix-daemon[3730]: accepted connection from pid 3750, user nixbot gitlab # [ 337.006246] nix-daemon[3730]: accepted connection from pid 3760, user nixbot gitlab # [ 337.025105] nix-daemon[3730]: accepted connection from pid 3750, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 337.875784] nixbot[3512]: INFO: ::ffff:127.0.0.1:47578 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 338.931710] nixbot[3512]: INFO: ::ffff:127.0.0.1:47592 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 339.986879] nixbot[3512]: INFO: ::ffff:127.0.0.1:47608 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 341.040396] nixbot[3512]: INFO: ::ffff:127.0.0.1:38312 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab # [ 341.703680] gitaly[922]: time="2026-08-11T10:13:30.557Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR507P20JRNXTEC58N7D6SF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:14:00.054" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:13:30.555" grpc.time_ms=1.352 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 341.904497] gitaly[922]: time="2026-08-11T10:13:30.758Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR507P20JRNXTEC58N7D6SF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:13:40.259" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:13:30.739" grpc.time_ms=18.689 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 342.075241] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 491 gitlab # [ 342.085100] nixbot[3512]: {"ts": "2026-08-11T10:13:30.929Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 \"HTTP/1.1 201 Created\""} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 342.093800] nixbot[3512]: INFO: ::ffff:127.0.0.1:38328 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab # [ 342.201333] gitaly[922]: time="2026-08-11T10:13:31.055Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR5085VYJXKJYD1PPK1JJ3Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:14:01.053" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:13:31.053" grpc.time_ms=1.368 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 342.281112] gitaly[922]: time="2026-08-11T10:13:31.135Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01KZR5085VYJXKJYD1PPK1JJ3Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:13:41.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:13:31.117" grpc.time_ms=17.692 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 342.411142] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 325 gitlab # [ 342.419438] nixbot[3512]: {"ts": "2026-08-11T10:13:31.267Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 \"HTTP/1.1 201 Created\""} gitlab # [ 342.523789] gitaly[922]: time="2026-08-11T10:13:31.378Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR508GWWMR86P9ZMVEAD036 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:14:01.075" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:13:31.376" grpc.time_ms=1.062 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 342.601140] gitaly[922]: time="2026-08-11T10:13:31.455Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01KZR508GWWMR86P9ZMVEAD036 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:13:41.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:13:31.437" grpc.time_ms=17.835 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 342.698320] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 259 gitlab # [ 342.706736] nixbot[3512]: {"ts": "2026-08-11T10:13:31.553Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 \"HTTP/1.1 201 Created\""} gitlab # [ 342.854702] nix-daemon[3730]: accepted connection from pid 3799, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 343.153345] nixbot[3512]: INFO: ::ffff:127.0.0.1:38334 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.07 seconds) gitlab # [ 343.249118] gitaly[922]: time="2026-08-11T10:13:32.102Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR5090J9XFJ0VPNZQM8ZKXN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:32.083" grpc.time_ms=18.695 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 343.280769] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:32 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 309 gitlab # [ 343.382934] gitaly[922]: time="2026-08-11T10:13:32.237Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR509ABY9ZAXYVEY9K6RNE9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:32.217" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 343.413693] gitaly[922]: time="2026-08-11T10:13:32.237Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01KZR509ABY9ZAXYVEY9K6RNE9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:32.217" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 343.442296] gitlab-workhorse[816]: time="2026-08-11T10:13:32Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 343.445696] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:13:32 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 131 gitlab # [ 343.448957] gitaly[922]: time="2026-08-11T10:13:32.237Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01KZR509ABY9ZAXYVEY9K6RNE9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:13:32.217" grpc.time_ms=20.508 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 343.566356] nix-daemon[3730]: accepted connection from pid 3827, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab # [ 344.219894] nixbot[3512]: INFO: ::ffff:127.0.0.1:38340 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 345.273158] nixbot[3512]: INFO: ::ffff:127.0.0.1:38350 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 346.329726] nixbot[3512]: INFO: ::ffff:127.0.0.1:38358 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 347.387184] nixbot[3512]: INFO: ::ffff:127.0.0.1:38374 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 348.440828] nixbot[3512]: INFO: ::ffff:127.0.0.1:38378 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 349.494475] nixbot[3512]: INFO: ::ffff:127.0.0.1:38392 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 350.552945] nixbot[3512]: INFO: ::ffff:127.0.0.1:38402 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 351.608723] nixbot[3512]: INFO: ::ffff:127.0.0.1:37118 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 352.665080] nixbot[3512]: INFO: ::ffff:127.0.0.1:37132 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 353.720193] nixbot[3512]: INFO: ::ffff:127.0.0.1:37146 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 354.773710] nixbot[3512]: INFO: ::ffff:127.0.0.1:37158 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 355.829264] nixbot[3512]: INFO: ::ffff:127.0.0.1:37172 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 356.886856] nixbot[3512]: INFO: ::ffff:127.0.0.1:37176 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 357.942951] nixbot[3512]: INFO: ::ffff:127.0.0.1:37186 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 358.999350] nixbot[3512]: INFO: ::ffff:127.0.0.1:37200 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 360.058007] nixbot[3512]: INFO: ::ffff:127.0.0.1:37204 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 361.112888] nixbot[3512]: INFO: ::ffff:127.0.0.1:39764 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 362.168729] nixbot[3512]: INFO: ::ffff:127.0.0.1:39766 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 363.225671] nixbot[3512]: INFO: ::ffff:127.0.0.1:39776 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 364.280355] nixbot[3512]: INFO: ::ffff:127.0.0.1:39780 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 365.333538] nixbot[3512]: INFO: ::ffff:127.0.0.1:39794 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 366.390266] nixbot[3512]: INFO: ::ffff:127.0.0.1:39802 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 367.443920] nixbot[3512]: INFO: ::ffff:127.0.0.1:39812 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 368.500294] nixbot[3512]: INFO: ::ffff:127.0.0.1:39828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab # [ 369.374360] sidekiq-cluster[3459]: 2026-08-11T10:13:58.227Z pid=3459 tid=yln INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3459, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433672192} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 369.558549] nixbot[3512]: INFO: ::ffff:127.0.0.1:39832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab # [ 369.653802] sidekiq-cluster[3459]: W, [2026-08-11T10:13:58.507971 #3459] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 369.716722] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:13:58.570Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 370.618141] nixbot[3512]: INFO: ::ffff:127.0.0.1:39842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 371.675033] nixbot[3512]: INFO: ::ffff:127.0.0.1:40236 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 372.729214] nixbot[3512]: INFO: ::ffff:127.0.0.1:40238 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab # [ 373.155465] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:02.008Z","message":"GitLab reliable fetch activated!"} gitlab # [ 373.160639] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:02.008Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 373.785215] nixbot[3512]: INFO: ::ffff:127.0.0.1:40254 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 374.840125] nixbot[3512]: INFO: ::ffff:127.0.0.1:40264 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 375.896330] nixbot[3512]: INFO: ::ffff:127.0.0.1:40270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 376.949205] nixbot[3512]: INFO: ::ffff:127.0.0.1:40286 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 378.002968] nixbot[3512]: INFO: ::ffff:127.0.0.1:40292 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab # [ 379.057551] nixbot[3512]: INFO: ::ffff:127.0.0.1:40300 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 380.112086] nixbot[3512]: INFO: ::ffff:127.0.0.1:40314 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 381.166579] nixbot[3512]: INFO: ::ffff:127.0.0.1:57520 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 382.222811] nixbot[3512]: INFO: ::ffff:127.0.0.1:57522 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 383.279665] nixbot[3512]: INFO: ::ffff:127.0.0.1:57526 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 384.334735] nixbot[3512]: INFO: ::ffff:127.0.0.1:57538 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 385.390484] nixbot[3512]: INFO: ::ffff:127.0.0.1:57542 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 386.447636] nixbot[3512]: INFO: ::ffff:127.0.0.1:57558 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 387.500560] nixbot[3512]: INFO: ::ffff:127.0.0.1:57572 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 388.556845] nixbot[3512]: INFO: ::ffff:127.0.0.1:57576 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 389.612220] nixbot[3512]: INFO: ::ffff:127.0.0.1:57582 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 390.665778] nixbot[3512]: INFO: ::ffff:127.0.0.1:57596 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 391.718705] nixbot[3512]: INFO: ::ffff:127.0.0.1:51778 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 392.773861] nixbot[3512]: INFO: ::ffff:127.0.0.1:51794 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 393.829184] nixbot[3512]: INFO: ::ffff:127.0.0.1:51804 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 394.885469] nixbot[3512]: INFO: ::ffff:127.0.0.1:51806 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 395.940836] nixbot[3512]: INFO: ::ffff:127.0.0.1:51818 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 396.996530] nixbot[3512]: INFO: ::ffff:127.0.0.1:51820 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 398.050280] nixbot[3512]: INFO: ::ffff:127.0.0.1:51836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 399.106292] nixbot[3512]: INFO: ::ffff:127.0.0.1:51848 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 400.162732] nixbot[3512]: INFO: ::ffff:127.0.0.1:51856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 401.219212] nixbot[3512]: INFO: ::ffff:127.0.0.1:46774 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 402.273038] nixbot[3512]: INFO: ::ffff:127.0.0.1:46784 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 403.329963] nixbot[3512]: INFO: ::ffff:127.0.0.1:46794 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 404.383195] nixbot[3512]: INFO: ::ffff:127.0.0.1:46798 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 405.439896] nixbot[3512]: INFO: ::ffff:127.0.0.1:46800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 406.493858] nixbot[3512]: INFO: ::ffff:127.0.0.1:46808 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 407.548367] nixbot[3512]: INFO: ::ffff:127.0.0.1:46810 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 408.600387] nixbot[3512]: INFO: ::ffff:127.0.0.1:46816 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 409.656325] nixbot[3512]: INFO: ::ffff:127.0.0.1:46826 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 410.713603] nixbot[3512]: INFO: ::ffff:127.0.0.1:46842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab # [ 410.825207] postgres[4049]: [4049] ERROR: relation "table_without_models" does not exist gitlab # [ 410.828843] postgres[4049]: [4049] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 411.767130] nixbot[3512]: INFO: ::ffff:127.0.0.1:34076 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 412.822203] nixbot[3512]: INFO: ::ffff:127.0.0.1:34078 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 413.877116] nixbot[3512]: INFO: ::ffff:127.0.0.1:34092 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 414.932235] nixbot[3512]: INFO: ::ffff:127.0.0.1:34096 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab # [ 415.664859] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:44.518Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 415.667688] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:44.521Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 415.672333] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:44.521Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 415.674133] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:44.521Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 415.676195] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:44.525Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 415.986915] nixbot[3512]: INFO: ::ffff:127.0.0.1:34112 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 417.071391] nixbot[3512]: INFO: ::ffff:127.0.0.1:34128 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.08 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.05 seconds) gitlab # [ 418.126854] nixbot[3512]: INFO: ::ffff:127.0.0.1:34132 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab # [ 418.317269] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:47.170Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"db3cf1b22061f7f53beac1aa","created_at":"2026-08-11T10:13:14.331Z","trace_propagation_headers":{"sentry-trace":"7044ab95d8764691ac1a146cc81d85f3-9b73af1d72994632","baggage":"sentry-trace_id=7044ab95d8764691ac1a146cc81d85f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4ZP6ZWYQ2EQNAJ6PSRJBH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:14.388Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-db3cf1b22061f7f53beac1aa: start","job_status":"start","queue_duration_s":92.781105,"scheduling_latency_s":92.781158} gitlab # [ 418.695991] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:47.549Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"db3cf1b22061f7f53beac1aa","created_at":"2026-08-11T10:13:14.331Z","trace_propagation_headers":{"sentry-trace":"7044ab95d8764691ac1a146cc81d85f3-9b73af1d72994632","baggage":"sentry-trace_id=7044ab95d8764691ac1a146cc81d85f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4ZP6ZWYQ2EQNAJ6PSRJBH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:14.388Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-db3cf1b22061f7f53beac1aa: done: 0.37909 sec","job_status":"done","queue_duration_s":92.781105,"scheduling_latency_s":92.781158,"redis_calls":23,"redis_duration_s":0.010859,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005813,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002751,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002295,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.192079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19384096,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.37909,"completed_at":"2026-08-11T10:14:47.548Z","load_balancing_strategy":"primary","db_duration_s":0.107989,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 418.796824] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:47.552Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"cb52184d7e711b396712ee87","created_at":"2026-08-11T10:13:14.407Z","trace_propagation_headers":{"sentry-trace":"7044ab95d8764691ac1a146cc81d85f3-9b73af1d72994632","baggage":"sentry-trace_id=7044ab95d8764691ac1a146cc81d85f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4ZP6ZWYQ2EQNAJ6PSRJBH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:14.415Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-cb52184d7e711b396712ee87: start","job_status":"start","queue_duration_s":93.136794,"scheduling_latency_s":93.136832} gitlab # [ 418.874216] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:47.727Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"cb52184d7e711b396712ee87","created_at":"2026-08-11T10:13:14.407Z","trace_propagation_headers":{"sentry-trace":"7044ab95d8764691ac1a146cc81d85f3-9b73af1d72994632","baggage":"sentry-trace_id=7044ab95d8764691ac1a146cc81d85f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4ZP6ZWYQ2EQNAJ6PSRJBH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:14.415Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-cb52184d7e711b396712ee87: done: 0.17582 sec","job_status":"done","queue_duration_s":93.136794,"scheduling_latency_s":93.136832,"redis_calls":14,"redis_duration_s":0.005159,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001179,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002409,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001571,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.129117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13442558,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.17582,"completed_at":"2026-08-11T10:14:47.727Z","load_balancing_strategy":"primary","db_duration_s":0.035473,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 418.960929] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:47.730Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"87d54d4cd4e8f51c47f9b72c","created_at":"2026-08-11T10:13:15.048Z","trace_propagation_headers":{"sentry-trace":"7044ab95d8764691ac1a146cc81d85f3-9b73af1d72994632","baggage":"sentry-trace_id=7044ab95d8764691ac1a146cc81d85f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4ZP6ZWYQ2EQNAJ6PSRJBH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:15.056Z","job_size_bytes":5,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-87d54d4cd4e8f51c47f9b72c: start","job_status":"start","queue_duration_s":92.674308,"scheduling_latency_s":92.674336} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 419.106266] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:47.960Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"87d54d4cd4e8f51c47f9b72c","created_at":"2026-08-11T10:13:15.048Z","trace_propagation_headers":{"sentry-trace":"7044ab95d8764691ac1a146cc81d85f3-9b73af1d72994632","baggage":"sentry-trace_id=7044ab95d8764691ac1a146cc81d85f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4ZP6ZWYQ2EQNAJ6PSRJBH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:15.056Z","job_size_bytes":5,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-87d54d4cd4e8f51c47f9b72c: done: 0.22973 sec","job_status":"done","queue_duration_s":92.674308,"scheduling_latency_s":92.674336,"redis_calls":12,"redis_duration_s":0.009266,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.002518,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00611,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.176215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054964,"duration_s":0.22973,"completed_at":"2026-08-11T10:14:47.959Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040908,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 419.211447] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:47.961Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"425cf2274a5c30f53c7f7b3d","created_at":"2026-08-11T10:13:15.090Z","trace_propagation_headers":{"sentry-trace":"7044ab95d8764691ac1a146cc81d85f3-9b73af1d72994632","baggage":"sentry-trace_id=7044ab95d8764691ac1a146cc81d85f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4ZP6ZWYQ2EQNAJ6PSRJBH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:15.095Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-425cf2274a5c30f53c7f7b3d: start","job_status":"start","queue_duration_s":92.866003,"scheduling_latency_s":92.866023} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.11 seconds) gitlab # [ 419.234962] nixbot[3512]: INFO: ::ffff:127.0.0.1:34138 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab # [ 419.473443] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:48.325Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"425cf2274a5c30f53c7f7b3d","created_at":"2026-08-11T10:13:15.090Z","trace_propagation_headers":{"sentry-trace":"7044ab95d8764691ac1a146cc81d85f3-9b73af1d72994632","baggage":"sentry-trace_id=7044ab95d8764691ac1a146cc81d85f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4ZP6ZWYQ2EQNAJ6PSRJBH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:15.095Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-425cf2274a5c30f53c7f7b3d: done: 0.363939 sec","job_status":"done","queue_duration_s":92.866003,"scheduling_latency_s":92.866023,"redis_calls":11,"redis_duration_s":0.003823,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000775,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000767,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.314,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.314,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.253666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00081878,"duration_s":0.363939,"completed_at":"2026-08-11T10:14:48.325Z","load_balancing_strategy":"primary","db_duration_s":0.115995,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.572158] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:48.328Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0300fa4adac0ab2b473c8caf","created_at":"2026-08-11T10:13:15.099Z","trace_propagation_headers":{"sentry-trace":"7044ab95d8764691ac1a146cc81d85f3-9b73af1d72994632","baggage":"sentry-trace_id=7044ab95d8764691ac1a146cc81d85f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4ZP6ZWYQ2EQNAJ6PSRJBH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:15.105Z","job_size_bytes":89,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0300fa4adac0ab2b473c8caf: start","job_status":"start","queue_duration_s":93.223343,"scheduling_latency_s":93.223376} gitlab # [ 419.593526] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:48.391Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0300fa4adac0ab2b473c8caf","created_at":"2026-08-11T10:13:15.099Z","trace_propagation_headers":{"sentry-trace":"7044ab95d8764691ac1a146cc81d85f3-9b73af1d72994632","baggage":"sentry-trace_id=7044ab95d8764691ac1a146cc81d85f3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4ZP6ZWYQ2EQNAJ6PSRJBH","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:15.105Z","job_size_bytes":89,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0300fa4adac0ab2b473c8caf: done: 0.06334 sec","job_status":"done","queue_duration_s":93.223343,"scheduling_latency_s":93.223376,"redis_calls":11,"redis_duration_s":0.003633,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001011,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000714,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053394,"duration_s":0.06334,"completed_at":"2026-08-11T10:14:48.391Z","load_balancing_strategy":"primary","db_duration_s":0.009626,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.641413] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:48.394Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a853b50dca3754bb96f3b0ab","created_at":"2026-08-11T10:13:18.553Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-283b5bc7746c4b44","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:18.562Z","job_size_bytes":185,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a853b50dca3754bb96f3b0ab: start","job_status":"start","queue_duration_s":89.832106,"scheduling_latency_s":89.83213} gitlab # [ 419.658301] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:48.417Z","message":"changes: \"0000000000000000000000000000000000000000 eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 refs/heads/master\\n\""} gitlab # [ 419.661057] gitaly[922]: time="2026-08-11T10:14:48.471Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:14:58.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:48.456" grpc.time_ms=14.454 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.674130] gitaly[922]: time="2026-08-11T10:14:48.491Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:14:58.026" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:14:48.477" grpc.time_ms=13.773 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.703383] gitaly[922]: time="2026-08-11T10:14:48.557Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-11T10:14:58.095" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:48.546" grpc.time_ms=11.546 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.747293] gitaly[922]: time="2026-08-11T10:14:48.601Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:14:48.600" grpc.time_ms=0.644 pid=922 span.kind=server system=grpc gitlab # [ 419.787898] gitaly[922]: time="2026-08-11T10:14:48.642Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:14:48.641" grpc.time_ms=0.401 pid=922 span.kind=server system=grpc gitlab # [ 419.816772] gitaly[922]: time="2026-08-11T10:14:48.650Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E diskcache=aa5c34cc-255f-492c-a6e3-c6e1f9f3a9b3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:14:58.118" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:14:48.569" pid=922 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 419.842317] gitaly[922]: time="2026-08-11T10:14:48.650Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=85 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5087 command.oublock=8 command.real_time_ms=76 command.spawn_token_fork_ms=0 command.system_time_ms=34 command.user_time_ms=51 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:14:58.118" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:14:48.569" grpc.time_ms=81.624 pid=922 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 419.867574] gitaly[922]: time="2026-08-11T10:14:48.666Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T10:14:58.216" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:14:48.666" grpc.time_ms=0.21 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.883219] gitaly[922]: time="2026-08-11T10:14:48.690Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=861 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-11T10:14:58.220" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:48.671" grpc.time_ms=19.083 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.990629] gitaly[922]: time="2026-08-11T10:14:48.844Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-11T10:15:18.033" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:48.834" grpc.time_ms=10.396 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 420.055575] gitaly[922]: time="2026-08-11T10:14:48.909Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:14:58.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:14:48.908" grpc.time_ms=0.644 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 420.087585] gitaly[922]: time="2026-08-11T10:14:48.926Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-11T10:14:58.014" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-11T10:14:48.914" grpc.time_ms=11.78 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 420.118826] gitaly[922]: time="2026-08-11T10:14:48.973Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:14:58.054" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:48.955" grpc.time_ms=17.565 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 420.148682] gitaly[922]: time="2026-08-11T10:14:49.002Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:14:58.084" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:48.984" grpc.time_ms=17.752 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 420.200262] gitaly[922]: time="2026-08-11T10:14:49.054Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=879 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T10:15:19.026" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:49.027" grpc.time_ms=27.19 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 420.298224] nixbot[3512]: INFO: ::ffff:127.0.0.1:34150 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.07 seconds) gitlab # [ 420.891394] gitaly[922]: time="2026-08-11T10:14:49.744Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-11T10:14:59.001" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:49.742" grpc.time_ms=2.32 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 420.969596] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:49.821Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a853b50dca3754bb96f3b0ab","created_at":"2026-08-11T10:13:18.553Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-283b5bc7746c4b44","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:18.562Z","job_size_bytes":185,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a853b50dca3754bb96f3b0ab: done: 1.427348 sec","job_status":"done","queue_duration_s":89.832106,"scheduling_latency_s":89.83213,"gitaly_calls":13,"gitaly_duration_s":0.283843,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.059423,"redis_read_bytes":2103,"redis_write_bytes":21752,"redis_cache_calls":15,"redis_cache_duration_s":0.007027,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009326,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002118,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7840,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005465,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.01952,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015967,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.091,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.321,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.37,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.091,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.992031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00080268,"exclusive_lock_hold_duration_s":0.040119619999999995,"duration_s":1.427348,"completed_at":"2026-08-11T10:14:49.821Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.157683,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 421.071100] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:49.825Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 e1496f12cf8f003731a971b021434c87a6fae7cf refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4abc5bb44a682b238362c464","created_at":"2026-08-11T10:13:23.288Z","trace_propagation_headers":{"sentry-trace":"fa3a9b5992c54c41bcf4e1858ed61780-18578ae9ee9a494e","baggage":"sentry-trace_id=fa3a9b5992c54c41bcf4e1858ed61780,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR50038472JPBB18WAEY4D9","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:23.290Z","job_size_bytes":185,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4abc5bb44a682b238362c464: start","job_status":"start","queue_duration_s":86.534192,"scheduling_latency_s":86.534239} gitlab # [ 421.093265] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:49.848Z","message":"changes: \"eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 e1496f12cf8f003731a971b021434c87a6fae7cf refs/heads/master\\n\""} gitlab # [ 421.096422] gitaly[922]: time="2026-08-11T10:14:49.900Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:14:59.142" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:49.882" grpc.time_ms=17.825 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 421.113472] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:49.932Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"72a180c7dcc1528444c1d85f","created_at":"2026-08-11T10:14:49.929Z","trace_propagation_headers":{"sentry-trace":"fa3a9b5992c54c41bcf4e1858ed61780-7f8157165e22401f","baggage":"sentry-trace_id=fa3a9b5992c54c41bcf4e1858ed61780,sentry-release=Unknown"},"correlation_id":"01KZR50038472JPBB18WAEY4D9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"e1c0c6fbc49e6a23f2042d8e","job_size_bytes":46,"pid":3459,"job_status":"deduplicated","message":"ProjectCacheWorker JID-72a180c7dcc1528444c1d85f: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 421.130527] gitaly[922]: time="2026-08-11T10:14:49.925Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T10:14:59.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:14:49.908" grpc.time_ms=16.92 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 421.144722] gitaly[922]: time="2026-08-11T10:14:49.973Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-11T10:14:59.054" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:49.955" grpc.time_ms=17.874 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 421.158730] gitaly[922]: time="2026-08-11T10:14:50.002Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-11T10:15:19.182" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:49.982" grpc.time_ms=19.401 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 421.179248] gitaly[922]: time="2026-08-11T10:14:50.033Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-11T10:15:00.001" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-11T10:14:50.021" grpc.time_ms=11.482 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 421.213736] gitaly[922]: time="2026-08-11T10:14:50.068Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:15:00.030" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:50.051" grpc.time_ms=16.731 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 421.358143] nixbot[3512]: INFO: ::ffff:127.0.0.1:45098 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.06 seconds) gitlab # [ 421.547949] gitaly[922]: time="2026-08-11T10:14:50.402Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-11T10:15:00.235" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:50.256" grpc.time_ms=145.551 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 421.587491] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:50.426Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 e1496f12cf8f003731a971b021434c87a6fae7cf refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4abc5bb44a682b238362c464","created_at":"2026-08-11T10:13:23.288Z","trace_propagation_headers":{"sentry-trace":"fa3a9b5992c54c41bcf4e1858ed61780-18578ae9ee9a494e","baggage":"sentry-trace_id=fa3a9b5992c54c41bcf4e1858ed61780,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR50038472JPBB18WAEY4D9","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T10:13:23.290Z","job_size_bytes":185,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4abc5bb44a682b238362c464: done: 0.601568 sec","job_status":"done","queue_duration_s":86.534192,"scheduling_latency_s":86.534239,"gitaly_calls":7,"gitaly_duration_s":0.273478,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.039302,"redis_read_bytes":500,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.006873,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001609,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005863,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.012387,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.01257,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.047,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.047,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.419966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00123336,"exclusive_lock_hold_duration_s":0.03483924,"duration_s":0.601568,"completed_at":"2026-08-11T10:14:50.426Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047082,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 421.672903] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:50.428Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"329a22d5d9edf06b19412548","created_at":"2026-08-11T10:13:24.825Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-2f1a9ad316554683","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:24.841Z","job_size_bytes":65,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-329a22d5d9edf06b19412548: start","job_status":"start","queue_duration_s":85.587008,"scheduling_latency_s":85.587031} gitlab # [ 421.692846] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:50.542Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"329a22d5d9edf06b19412548","created_at":"2026-08-11T10:13:24.825Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-2f1a9ad316554683","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:24.841Z","job_size_bytes":65,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-329a22d5d9edf06b19412548: done: 0.114606 sec","job_status":"done","queue_duration_s":85.587008,"scheduling_latency_s":85.587031,"redis_calls":16,"redis_duration_s":0.005449,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002982,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00185,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000617,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052722,"duration_s":0.114606,"completed_at":"2026-08-11T10:14:50.542Z","load_balancing_strategy":"primary","db_duration_s":0.037532,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 421.742082] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:50.544Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0dac5295eb6621dceced6c04","created_at":"2026-08-11T10:13:24.845Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-2f1a9ad316554683","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:24.857Z","job_size_bytes":65,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0dac5295eb6621dceced6c04: start","job_status":"start","queue_duration_s":85.687089,"scheduling_latency_s":85.687114} gitlab # [ 421.857237] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:50.710Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0dac5295eb6621dceced6c04","created_at":"2026-08-11T10:13:24.845Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-2f1a9ad316554683","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:24.857Z","job_size_bytes":65,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0dac5295eb6621dceced6c04: done: 0.165203 sec","job_status":"done","queue_duration_s":85.687089,"scheduling_latency_s":85.687114,"redis_calls":21,"redis_duration_s":0.007078,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002677,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002453,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001948,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00095644,"duration_s":0.165203,"completed_at":"2026-08-11T10:14:50.710Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050146,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.954218] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:50.713Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0fb52db451cfdb1b538c67bd","created_at":"2026-08-11T10:13:25.104Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-2f1a9ad316554683","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:25.119Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0fb52db451cfdb1b538c67bd: start","job_status":"start","queue_duration_s":85.594736,"scheduling_latency_s":85.594781} gitlab # [ 422.238692] gitaly[922]: time="2026-08-11T10:14:51.091Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:14:51.090" grpc.time_ms=0.818 pid=922 span.kind=server system=grpc gitlab # [ 422.289770] gitaly[922]: time="2026-08-11T10:14:51.144Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:14:51.143" grpc.time_ms=0.765 pid=922 span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 422.345655] gitaly[922]: time="2026-08-11T10:14:51.199Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:14:51.198" grpc.time_ms=1.141 pid=922 span.kind=server system=grpc gitlab # [ 422.374554] gitaly[922]: time="2026-08-11T10:14:51.212Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 diskcache=65ef102b-4027-4e24-9a43-956ed3a8bfa0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:15:21.029" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:51.030" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 422.398275] gitaly[922]: time="2026-08-11T10:14:51.213Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=209 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7442 command.oublock=0 command.real_time_ms=175 command.spawn_token_fork_ms=1 command.system_time_ms=99 command.user_time_ms=110 component=gitaly.UnaryServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:15:21.029" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:51.030" grpc.time_ms=182.91 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 422.422625] nixbot[3512]: INFO: ::ffff:127.0.0.1:45108 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.07 seconds) gitlab # [ 422.605090] gitaly[922]: time="2026-08-11T10:14:51.459Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:15:21.456" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:51.457" grpc.time_ms=1.719 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 422.692776] gitaly[922]: time="2026-08-11T10:14:51.547Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR501HTGSPXQH5M3817ZTT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:21.544" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:51.545" grpc.time_ms=1.315 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 422.738113] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:51.588Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0fb52db451cfdb1b538c67bd","created_at":"2026-08-11T10:13:25.104Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-2f1a9ad316554683","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:13:25.119Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0fb52db451cfdb1b538c67bd: done: 0.875042 sec","job_status":"done","queue_duration_s":85.594736,"scheduling_latency_s":85.594781,"gitaly_calls":3,"gitaly_duration_s":0.198913,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.050413,"redis_read_bytes":457,"redis_write_bytes":28000,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002793,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00262,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.017248,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.00683,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14494,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.009137,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001326,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003232,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004434,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.106,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.051,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.056,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.055,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.540582,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.7450690200000001,"duration_s":0.875042,"completed_at":"2026-08-11T10:14:51.588Z","load_balancing_strategy":"primary","db_duration_s":0.124898,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 422.836898] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:51.593Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"e1c0c6fbc49e6a23f2042d8e","created_at":"2026-08-11T10:14:48.494Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-ebe9f9d9c55049a7","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:48.513Z","job_size_bytes":46,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-e1c0c6fbc49e6a23f2042d8e: start","job_status":"start","queue_duration_s":3.080305,"scheduling_latency_s":3.080373} gitlab # [ 422.856076] gitaly[922]: time="2026-08-11T10:14:51.710Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-11T16:14:51.698" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:14:51.699" grpc.time_ms=10.399 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 422.890256] gitaly[922]: time="2026-08-11T10:14:51.744Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-11T10:15:21.725" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:51.726" grpc.time_ms=18.083 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 422.946820] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:51.800Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"e1c0c6fbc49e6a23f2042d8e","created_at":"2026-08-11T10:14:48.494Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-ebe9f9d9c55049a7","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:48.513Z","job_size_bytes":46,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-e1c0c6fbc49e6a23f2042d8e: done: 0.206653 sec","job_status":"done","queue_duration_s":3.080305,"scheduling_latency_s":3.080373,"gitaly_calls":2,"gitaly_duration_s":0.036142,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.013532,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002647,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000985,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003239,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.005335,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001326,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.137992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00060018,"duration_s":0.206653,"completed_at":"2026-08-11T10:14:51.800Z","load_balancing_strategy":"primary","db_duration_s":0.020243,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 423.039248] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:51.803Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"9fd95b3d051209de16891150","created_at":"2026-08-11T10:14:48.535Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-ebe9f9d9c55049a7","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:48.541Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-9fd95b3d051209de16891150: start","job_status":"start","queue_duration_s":3.261955,"scheduling_latency_s":3.261991} gitlab # [ 423.062461] gitaly[922]: time="2026-08-11T10:14:51.878Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E diskcache=85fa66e8-cd99-4424-a8d2-f357fe21f10c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:14:51.844" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:51.844" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.076741] gitaly[922]: time="2026-08-11T10:14:51.879Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=39 command.spawn_token_fork_ms=3 command.system_time_ms=23 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:14:51.844" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:51.844" grpc.time_ms=33.868 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.096338] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:51.945Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"9fd95b3d051209de16891150","created_at":"2026-08-11T10:14:48.535Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-ebe9f9d9c55049a7","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:48.541Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-9fd95b3d051209de16891150: done: 0.142336 sec","job_status":"done","queue_duration_s":3.261955,"scheduling_latency_s":3.261991,"gitaly_calls":1,"gitaly_duration_s":0.037579,"redis_calls":15,"redis_duration_s":0.0060149999999999995,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000752,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002309,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001176,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001778,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.018,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.035,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10089872,"duration_s":0.142336,"completed_at":"2026-08-11T10:14:51.945Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024923,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.146223] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:51.948Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"126a4a483bd96af4ff99e9d7","created_at":"2026-08-11T10:14:48.661Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-ebe9f9d9c55049a7","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:48.663Z","job_size_bytes":23,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-126a4a483bd96af4ff99e9d7: start","job_status":"start","queue_duration_s":3.284776,"scheduling_latency_s":3.284811} gitlab # [ 423.162277] gitaly[922]: time="2026-08-11T10:14:52.007Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-11T10:15:21.088" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:51.989" grpc.time_ms=17.688 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.175551] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:52.020Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"126a4a483bd96af4ff99e9d7","created_at":"2026-08-11T10:14:48.661Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-ebe9f9d9c55049a7","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:48.663Z","job_size_bytes":23,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-126a4a483bd96af4ff99e9d7: done: 0.071911 sec","job_status":"done","queue_duration_s":3.284776,"scheduling_latency_s":3.284811,"gitaly_calls":1,"gitaly_duration_s":0.020394,"redis_calls":16,"redis_duration_s":0.005494,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000481,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001556,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002414,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.071911,"completed_at":"2026-08-11T10:14:52.020Z","load_balancing_strategy":"primary","db_duration_s":0.004695,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 423.221897] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:52.022Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ffb7a742199c65e6220224f6","created_at":"2026-08-11T10:14:49.459Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-ebe9f9d9c55049a7","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:087dd2ba438a75de93adb0a1adf38e95c280e19bd042a6e81677b1c355477497","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:49.471Z","job_size_bytes":467,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ffb7a742199c65e6220224f6: start","job_status":"start","queue_duration_s":2.551149,"scheduling_latency_s":2.551175} gitlab # [ 423.239812] gitaly[922]: time="2026-08-11T10:14:52.060Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:22.058" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:52.058" grpc.time_ms=0.88 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.252643] gitaly[922]: time="2026-08-11T10:14:52.079Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:15:02.042" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:52.063" grpc.time_ms=16.661 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 423.380668] gitaly[922]: time="2026-08-11T10:14:52.234Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:15:22.233" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:52.233" grpc.time_ms=1.216 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 423.417044] gitaly[922]: time="2026-08-11T10:14:52.243Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=222 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-11T10:15:22.238" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:52.239" grpc.time_ms=4.379 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.07 seconds) gitlab # [ 423.500919] nixbot[3512]: INFO: ::ffff:127.0.0.1:45114 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab # [ 423.507303] gitaly[922]: time="2026-08-11T10:14:52.356Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:15:02.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:52.336" grpc.time_ms=19.276 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.100808] gitaly[922]: time="2026-08-11T10:14:52.955Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=883 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T10:15:22.027" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:52.927" grpc.time_ms=27.294 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.145152] gitaly[922]: time="2026-08-11T10:14:52.981Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR4ZTTC42HX6G61SCNTY17E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-11T10:15:22.058" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:52.958" grpc.time_ms=22.676 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.193713] sidekiq-cluster[3459]: {"severity":"WARN","time":"2026-08-11T10:14:53.046Z","class":"CreatePipelineWorker","correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0","ref":"refs/heads/master"},"retry":0} gitlab # [ 424.215797] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:53.063Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ffb7a742199c65e6220224f6","created_at":"2026-08-11T10:14:49.459Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-ebe9f9d9c55049a7","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:087dd2ba438a75de93adb0a1adf38e95c280e19bd042a6e81677b1c355477497","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:49.471Z","job_size_bytes":467,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ffb7a742199c65e6220224f6: done: 1.040946 sec","job_status":"done","queue_duration_s":2.551149,"scheduling_latency_s":2.551175,"gitaly_calls":7,"gitaly_duration_s":0.113405,"redis_calls":51,"redis_duration_s":0.014186,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001138,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005806,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002234,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003339,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.846261,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062678,"duration_s":1.040946,"completed_at":"2026-08-11T10:14:53.063Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08026,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 424.296913] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:53.067Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"cc6dc3a7-7bf3-41cc-b62d-636670795d3d\"}"],"class":"WebHookWorker","jid":"da139df0301064f122fa4f4b","created_at":"2026-08-11T10:14:49.699Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-ebe9f9d9c55049a7","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:318269214b6578a8aa72db46bafa38a0a978e5048c4f0a796d0a2581284dddb4","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:49.706Z","job_size_bytes":1751,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-da139df0301064f122fa4f4b: start","job_status":"start","queue_duration_s":3.360609,"scheduling_latency_s":3.360648} gitlab # [ 424.458110] nixbot[3512]: INFO: ::ffff:127.0.0.1:45118 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.09 seconds) gitlab # [ 424.500195] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:53.353Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"cc6dc3a7-7bf3-41cc-b62d-636670795d3d\"}"],"class":"WebHookWorker","jid":"da139df0301064f122fa4f4b","created_at":"2026-08-11T10:14:49.699Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-ebe9f9d9c55049a7","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:318269214b6578a8aa72db46bafa38a0a978e5048c4f0a796d0a2581284dddb4","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:49.706Z","job_size_bytes":1751,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-da139df0301064f122fa4f4b: done: 0.285813 sec","job_status":"done","queue_duration_s":3.360609,"scheduling_latency_s":3.360648,"redis_calls":19,"redis_duration_s":0.00701,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00173,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000722,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00308,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001478,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.08903113999997458,"cpu_s":0.17118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00078896,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.285813,"completed_at":"2026-08-11T10:14:53.352Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005172,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.617893] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:53.357Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"0d4774deea4ef277a64d9932","created_at":"2026-08-11T10:14:49.944Z","trace_propagation_headers":{"sentry-trace":"fa3a9b5992c54c41bcf4e1858ed61780-7f8157165e22401f","baggage":"sentry-trace_id=fa3a9b5992c54c41bcf4e1858ed61780,sentry-release=Unknown"},"correlation_id":"01KZR50038472JPBB18WAEY4D9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"9fd95b3d051209de16891150","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:49.948Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-0d4774deea4ef277a64d9932: start","job_status":"start","queue_duration_s":3.408259,"scheduling_latency_s":3.408305} gitlab # [ 424.643169] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:53.460Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"0d4774deea4ef277a64d9932","created_at":"2026-08-11T10:14:49.944Z","trace_propagation_headers":{"sentry-trace":"fa3a9b5992c54c41bcf4e1858ed61780-7f8157165e22401f","baggage":"sentry-trace_id=fa3a9b5992c54c41bcf4e1858ed61780,sentry-release=Unknown"},"correlation_id":"01KZR50038472JPBB18WAEY4D9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"9fd95b3d051209de16891150","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:49.948Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-0d4774deea4ef277a64d9932: done: 0.103553 sec","job_status":"done","queue_duration_s":3.408259,"scheduling_latency_s":3.408305,"gitaly_calls":1,"gitaly_duration_s":0.021344,"redis_calls":12,"redis_duration_s":0.01159,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002356,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001073,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008161,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05368182,"duration_s":0.103553,"completed_at":"2026-08-11T10:14:53.460Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014318,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.693632] nixbot[3512]: INFO: ::ffff:127.0.0.1:45128 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab # [ 424.695816] gitaly[922]: time="2026-08-11T10:14:53.419Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 diskcache=72ae7c85-54ae-4b88-bb95-964dc0b2d8ee grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:14:53.403" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:53.403" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.705930] gitaly[922]: time="2026-08-11T10:14:53.419Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T16:14:53.403" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:53.403" grpc.time_ms=15.655 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.719683] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 163 gitlab # [ 424.721947] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:53.464Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"e5393afccbe2401421a1d92b","created_at":"2026-08-11T10:14:50.179Z","trace_propagation_headers":{"sentry-trace":"fa3a9b5992c54c41bcf4e1858ed61780-7f8157165e22401f","baggage":"sentry-trace_id=fa3a9b5992c54c41bcf4e1858ed61780,sentry-release=Unknown"},"correlation_id":"01KZR50038472JPBB18WAEY4D9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31f8b3cfcdfb1af7540c6ad2195bf2f294b43a960e4d749eb272c8051a9982ec","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:50.184Z","job_size_bytes":467,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-e5393afccbe2401421a1d92b: start","job_status":"start","queue_duration_s":3.279587,"scheduling_latency_s":3.279634} gitlab # [ 424.739712] gitaly[922]: time="2026-08-11T10:14:53.506Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:23.005" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:53.505" grpc.time_ms=1.137 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.752462] gitaly[922]: time="2026-08-11T10:14:53.527Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:15:03.180" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:53.511" grpc.time_ms=16.459 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.765844] gitaly[922]: time="2026-08-11T10:14:53.529Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR52RNN7X46Y3YCTPHVDYP2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:53.515" grpc.time_ms=14.141 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 424.779122] gitaly[922]: time="2026-08-11T10:14:53.585Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:15:23.083" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:53.584" grpc.time_ms=1.418 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.792959] gitaly[922]: time="2026-08-11T10:14:53.595Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=161 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-11T10:15:23.090" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:53.590" grpc.time_ms=4.207 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.809274] gitaly[922]: time="2026-08-11T10:14:53.645Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:15:03.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:53.634" grpc.time_ms=10.702 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.875392] gitaly[922]: time="2026-08-11T10:14:53.729Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR52RTWX6EBJJ7YVJZV5957 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:53.711" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 424.904894] gitaly[922]: time="2026-08-11T10:14:53.729Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52RTWX6EBJJ7YVJZV5957 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:53.711" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 424.932671] gitlab-workhorse[816]: time="2026-08-11T10:14:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 424.937193] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 198 gitlab # [ 424.941595] nixbot[3512]: {"ts": "2026-08-11T10:14:53.770Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 424.946954] gitaly[922]: time="2026-08-11T10:14:53.730Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52RTWX6EBJJ7YVJZV5957 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:53.711" grpc.time_ms=18.119 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 425.023514] gitaly[922]: time="2026-08-11T10:14:53.877Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52S2WW61XX1MR9865AT87 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:23.675" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:53.876" grpc.time_ms=1.168 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.151974] gitaly[922]: time="2026-08-11T10:14:54.006Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR52S2WW61XX1MR9865AT87 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:15:03.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:53.987" grpc.time_ms=18.678 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.227056] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 292 gitlab # [ 425.235343] nixbot[3512]: {"ts": "2026-08-11T10:14:54.083Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 \"HTTP/1.1 201 Created\""} gitlab # [ 425.292417] gitaly[922]: time="2026-08-11T10:14:54.146Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52SC7TYAQ80VY7SXKVRNK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:24.144" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:54.145" grpc.time_ms=1.064 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.380486] gitaly[922]: time="2026-08-11T10:14:54.234Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR52SC7TYAQ80VY7SXKVRNK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:15:04.107" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:54.217" grpc.time_ms=16.715 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.482756] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 249 gitlab # [ 425.485638] nixbot[3512]: {"ts": "2026-08-11T10:14:54.338Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 \"HTTP/1.1 201 Created\""} gitlab # [ 425.488518] gitaly[922]: time="2026-08-11T10:14:54.340Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=884 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T10:15:24.012" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:54.313" grpc.time_ms=27.52 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.514773] gitaly[922]: time="2026-08-11T10:14:54.369Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR50038472JPBB18WAEY4D9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-11T10:15:24.046" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:54.347" grpc.time_ms=21.829 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.544278] sidekiq-cluster[3459]: {"severity":"WARN","time":"2026-08-11T10:14:54.397Z","class":"CreatePipelineWorker","correlation_id":"01KZR50038472JPBB18WAEY4D9","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0","after":"e1496f12cf8f003731a971b021434c87a6fae7cf","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"e1496f12cf8f003731a971b021434c87a6fae7cf","ref":"refs/heads/master"},"retry":0} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 425.558212] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.411Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"e5393afccbe2401421a1d92b","created_at":"2026-08-11T10:14:50.179Z","trace_propagation_headers":{"sentry-trace":"fa3a9b5992c54c41bcf4e1858ed61780-7f8157165e22401f","baggage":"sentry-trace_id=fa3a9b5992c54c41bcf4e1858ed61780,sentry-release=Unknown"},"correlation_id":"01KZR50038472JPBB18WAEY4D9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31f8b3cfcdfb1af7540c6ad2195bf2f294b43a960e4d749eb272c8051a9982ec","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:50.184Z","job_size_bytes":467,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-e5393afccbe2401421a1d92b: done: 0.947286 sec","job_status":"done","queue_duration_s":3.279587,"scheduling_latency_s":3.279634,"gitaly_calls":7,"gitaly_duration_s":0.10685,"redis_calls":33,"redis_duration_s":0.010207,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001377,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00481,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00202,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.810655,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.947286,"completed_at":"2026-08-11T10:14:54.411Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026479,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 425.609696] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.415Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"cd331c00-e8a3-48dd-a8d9-5a248ee6cfbc\"}"],"class":"WebHookWorker","jid":"304a275be05bc102a319ec22","created_at":"2026-08-11T10:14:50.221Z","trace_propagation_headers":{"sentry-trace":"fa3a9b5992c54c41bcf4e1858ed61780-7f8157165e22401f","baggage":"sentry-trace_id=fa3a9b5992c54c41bcf4e1858ed61780,sentry-release=Unknown"},"correlation_id":"01KZR50038472JPBB18WAEY4D9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b216adf0cedd8e7f01bfca66328f0d6cb147736ed35e4325b29015cda449f128","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:50.227Z","job_size_bytes":1749,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-304a275be05bc102a319ec22: start","job_status":"start","queue_duration_s":4.188648,"scheduling_latency_s":4.188697} gitlab # [ 425.629007] gitaly[922]: time="2026-08-11T10:14:54.436Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52SMCA6850H3N6G0V8WYX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:24.234" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:54.435" grpc.time_ms=1.457 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.641901] nixbot[3512]: INFO: ::ffff:127.0.0.1:45130 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.09 seconds) gitlab # [ 425.643195] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.496Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"cd331c00-e8a3-48dd-a8d9-5a248ee6cfbc\"}"],"class":"WebHookWorker","jid":"304a275be05bc102a319ec22","created_at":"2026-08-11T10:14:50.221Z","trace_propagation_headers":{"sentry-trace":"fa3a9b5992c54c41bcf4e1858ed61780-7f8157165e22401f","baggage":"sentry-trace_id=fa3a9b5992c54c41bcf4e1858ed61780,sentry-release=Unknown"},"correlation_id":"01KZR50038472JPBB18WAEY4D9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b216adf0cedd8e7f01bfca66328f0d6cb147736ed35e4325b29015cda449f128","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:50.227Z","job_size_bytes":1749,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-304a275be05bc102a319ec22: done: 0.081055 sec","job_status":"done","queue_duration_s":4.188648,"scheduling_latency_s":4.188697,"redis_calls":14,"redis_duration_s":0.005366,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000543,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003134,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001689,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.008783679999964988,"cpu_s":0.046693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.081055,"completed_at":"2026-08-11T10:14:54.496Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003939,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 425.692479] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.499Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"26ff93ba9ed2587af41e1a30","created_at":"2026-08-11T10:14:50.995Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.007Z","job_size_bytes":23,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-26ff93ba9ed2587af41e1a30: start","job_status":"start","queue_duration_s":3.49281,"scheduling_latency_s":3.492841} gitlab # [ 425.709295] nixbot[3512]: INFO: ::ffff:127.0.0.1:45142 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab # [ 425.711536] gitaly[922]: time="2026-08-11T10:14:54.507Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=6 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR52SMCA6850H3N6G0V8WYX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:15:04.141" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:54.491" grpc.time_ms=15.171 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.735566] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 240 gitlab # [ 425.738378] nixbot[3512]: {"ts": "2026-08-11T10:14:54.591Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/eb7e2f7c17683ff7f6490b2d5daef9caabfd1cc0 \"HTTP/1.1 201 Created\""} gitlab # [ 425.774859] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.628Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"26ff93ba9ed2587af41e1a30","created_at":"2026-08-11T10:14:50.995Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.007Z","job_size_bytes":23,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-26ff93ba9ed2587af41e1a30: done: 0.128379 sec","job_status":"done","queue_duration_s":3.49281,"scheduling_latency_s":3.492841,"redis_calls":10,"redis_duration_s":0.004816,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002124,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001393,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00068024,"duration_s":0.128379,"completed_at":"2026-08-11T10:14:54.628Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019967,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 425.827810] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.634Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b74ad8524594e119c0def83e","created_at":"2026-08-11T10:14:51.223Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.237Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b74ad8524594e119c0def83e: start","job_status":"start","queue_duration_s":3.397058,"scheduling_latency_s":3.397103} gitlab # [ 425.845665] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.684Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b74ad8524594e119c0def83e","created_at":"2026-08-11T10:14:51.223Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.237Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b74ad8524594e119c0def83e: done: 0.050488 sec","job_status":"done","queue_duration_s":3.397058,"scheduling_latency_s":3.397103,"redis_calls":10,"redis_duration_s":0.0060680000000000005,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000357,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002416,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003295,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027036,"duration_s":0.050488,"completed_at":"2026-08-11T10:14:54.684Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004944,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 425.891041] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.686Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d556a2f8a0618fd36d8385d7","created_at":"2026-08-11T10:14:51.269Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.281Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d556a2f8a0618fd36d8385d7: start","job_status":"start","queue_duration_s":3.404929,"scheduling_latency_s":3.404946} gitlab # [ 425.907446] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 127 gitlab # [ 425.909715] gitaly[922]: time="2026-08-11T10:14:54.682Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR52STVZJJ6E1WJSY7VCMBB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:54.663" grpc.time_ms=18.257 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 425.923106] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.722Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d556a2f8a0618fd36d8385d7","created_at":"2026-08-11T10:14:51.269Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.281Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d556a2f8a0618fd36d8385d7: done: 0.036509 sec","job_status":"done","queue_duration_s":3.404929,"scheduling_latency_s":3.404946,"redis_calls":10,"redis_duration_s":0.001453,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00031,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025286,"duration_s":0.036509,"completed_at":"2026-08-11T10:14:54.722Z","load_balancing_strategy":"primary","db_duration_s":0.004538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 425.967812] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.724Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"ed88268e17ce6a35bffd75ed","created_at":"2026-08-11T10:14:51.313Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.323Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-ed88268e17ce6a35bffd75ed: start","job_status":"start","queue_duration_s":3.401026,"scheduling_latency_s":3.401044} gitlab # [ 425.983448] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.765Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"ed88268e17ce6a35bffd75ed","created_at":"2026-08-11T10:14:51.313Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.323Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-ed88268e17ce6a35bffd75ed: done: 0.041617 sec","job_status":"done","queue_duration_s":3.401026,"scheduling_latency_s":3.401044,"redis_calls":13,"redis_duration_s":0.002865,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000423,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069074,"duration_s":0.041617,"completed_at":"2026-08-11T10:14:54.765Z","load_balancing_strategy":"primary","db_duration_s":0.007589,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 426.031650] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.767Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9bd37d9b5b7887f427bd8f9b","created_at":"2026-08-11T10:14:51.324Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.334Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9bd37d9b5b7887f427bd8f9b: start","job_status":"start","queue_duration_s":3.432888,"scheduling_latency_s":3.432906} gitlab # [ 426.049170] gitlab-workhorse[816]: time="2026-08-11T10:14:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 426.051093] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 111 gitlab # [ 426.053135] gitaly[922]: time="2026-08-11T10:14:54.796Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR52SYX5JTJSY1HBCQNJPTV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:54.776" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 426.063482] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.832Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9bd37d9b5b7887f427bd8f9b","created_at":"2026-08-11T10:14:51.324Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.334Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9bd37d9b5b7887f427bd8f9b: done: 0.064906 sec","job_status":"done","queue_duration_s":3.432888,"scheduling_latency_s":3.432906,"redis_calls":10,"redis_duration_s":0.004179,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001037,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002556,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000586,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00107216,"duration_s":0.064906,"completed_at":"2026-08-11T10:14:54.832Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011402,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 426.108552] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.835Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"07fc16199000168e72c9a401","created_at":"2026-08-11T10:14:51.335Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.345Z","job_size_bytes":19,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-07fc16199000168e72c9a401: start","job_status":"start","queue_duration_s":3.489542,"scheduling_latency_s":3.489563} gitlab # [ 426.125018] gitaly[922]: time="2026-08-11T10:14:54.796Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52SYX5JTJSY1HBCQNJPTV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:54.776" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 426.138815] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 81 gitlab # [ 426.140977] gitlab-workhorse[816]: time="2026-08-11T10:14:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 426.142789] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 74 gitlab # [ 426.145095] nix-daemon[3730]: accepted connection from pid 4300, user nixbot gitlab # [ 426.146111] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.873Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"07fc16199000168e72c9a401","created_at":"2026-08-11T10:14:51.335Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.345Z","job_size_bytes":19,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-07fc16199000168e72c9a401: done: 0.038279 sec","job_status":"done","queue_duration_s":3.489542,"scheduling_latency_s":3.489563,"redis_calls":11,"redis_duration_s":0.005235,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000639,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003401,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001195,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003178,"duration_s":0.038279,"completed_at":"2026-08-11T10:14:54.873Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003942,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 426.191300] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.875Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c2e14370923bbe3173b9846f","created_at":"2026-08-11T10:14:51.350Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.357Z","job_size_bytes":66,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c2e14370923bbe3173b9846f: start","job_status":"start","queue_duration_s":3.517575,"scheduling_latency_s":3.517595} gitlab # [ 426.209058] gitaly[922]: time="2026-08-11T10:14:54.796Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52SYX5JTJSY1HBCQNJPTV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:54.776" grpc.time_ms=20.183 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 426.223842] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.909Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c2e14370923bbe3173b9846f","created_at":"2026-08-11T10:14:51.350Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.357Z","job_size_bytes":66,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c2e14370923bbe3173b9846f: done: 0.03465 sec","job_status":"done","queue_duration_s":3.517575,"scheduling_latency_s":3.517595,"redis_calls":10,"redis_duration_s":0.001665,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000381,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026346,"duration_s":0.03465,"completed_at":"2026-08-11T10:14:54.909Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 426.271548] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.911Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"6aac01be0c2c7c4c94743d87","created_at":"2026-08-11T10:14:51.358Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.365Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6aac01be0c2c7c4c94743d87: start","job_status":"start","queue_duration_s":3.545743,"scheduling_latency_s":3.545767} gitlab # [ 426.288325] gitaly[922]: time="2026-08-11T10:14:54.908Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR52T3B4GTGEA4XPBA8ZCP5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:54.900" grpc.time_ms=8.55 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 426.301461] gitaly[922]: time="2026-08-11T10:14:54.988Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR52T621FWGC16JJW715AM1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:54.976" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 426.311713] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:55 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 64 gitlab # [ 426.314007] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.953Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"6aac01be0c2c7c4c94743d87","created_at":"2026-08-11T10:14:51.358Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.365Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-6aac01be0c2c7c4c94743d87: done: 0.042164 sec","job_status":"done","queue_duration_s":3.545743,"scheduling_latency_s":3.545767,"redis_calls":10,"redis_duration_s":0.0014349999999999999,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000309,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026112,"duration_s":0.042164,"completed_at":"2026-08-11T10:14:54.953Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004555,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 426.359693] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.954Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"66b634b5c7c243f94568ccee","created_at":"2026-08-11T10:14:51.374Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.386Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-66b634b5c7c243f94568ccee: start","job_status":"start","queue_duration_s":3.567739,"scheduling_latency_s":3.567764} gitlab # [ 426.381142] gitaly[922]: time="2026-08-11T10:14:54.988Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52T621FWGC16JJW715AM1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:54.976" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 426.396449] gitlab-workhorse[816]: time="2026-08-11T10:14:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 426.398397] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 110 gitlab # [ 426.400685] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.992Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"66b634b5c7c243f94568ccee","created_at":"2026-08-11T10:14:51.374Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.386Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-66b634b5c7c243f94568ccee: done: 0.0381 sec","job_status":"done","queue_duration_s":3.567739,"scheduling_latency_s":3.567764,"redis_calls":10,"redis_duration_s":0.001645,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000343,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000344,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027012,"duration_s":0.0381,"completed_at":"2026-08-11T10:14:54.992Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008379,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 426.447241] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:54.994Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"78c75c1ee2685c67126e4c09","created_at":"2026-08-11T10:14:51.388Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.401Z","job_size_bytes":6,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-78c75c1ee2685c67126e4c09: start","job_status":"start","queue_duration_s":3.592315,"scheduling_latency_s":3.592337} gitlab # [ 426.463814] gitaly[922]: time="2026-08-11T10:14:54.988Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52T621FWGC16JJW715AM1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:54.976" grpc.time_ms=12.014 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 426.478787] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.019Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"78c75c1ee2685c67126e4c09","created_at":"2026-08-11T10:14:51.388Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.401Z","job_size_bytes":6,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-78c75c1ee2685c67126e4c09: done: 0.025304 sec","job_status":"done","queue_duration_s":3.592315,"scheduling_latency_s":3.592337,"redis_calls":10,"redis_duration_s":0.001658,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000311,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000338,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037218,"duration_s":0.025304,"completed_at":"2026-08-11T10:14:55.019Z","load_balancing_strategy":"primary","db_duration_s":0.002035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 426.522854] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.020Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1f1d62db686c20f513f13422","created_at":"2026-08-11T10:14:51.403Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.413Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1f1d62db686c20f513f13422: start","job_status":"start","queue_duration_s":3.60735,"scheduling_latency_s":3.60737} gitlab # [ 426.538985] gitaly[922]: time="2026-08-11T10:14:55.096Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KZR52T9SNR50CBQ4SCR9V40Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:55.086" grpc.time_ms=10.095 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 426.552974] gitaly[922]: time="2026-08-11T10:14:55.208Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR52TBV6KPZ58V6121F0BHZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:55.186" pid=922 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 426.563907] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.059Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1f1d62db686c20f513f13422","created_at":"2026-08-11T10:14:51.403Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.413Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1f1d62db686c20f513f13422: done: 0.038908 sec","job_status":"done","queue_duration_s":3.60735,"scheduling_latency_s":3.60737,"redis_calls":10,"redis_duration_s":0.00139,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023886,"duration_s":0.038908,"completed_at":"2026-08-11T10:14:55.059Z","load_balancing_strategy":"primary","db_duration_s":0.007847,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 426.608294] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.060Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"1a6b0f938208a99477a10e66","created_at":"2026-08-11T10:14:51.426Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.436Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-1a6b0f938208a99477a10e66: start","job_status":"start","queue_duration_s":3.624181,"scheduling_latency_s":3.624202} gitlab # [ 426.624586] gitaly[922]: time="2026-08-11T10:14:55.208Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52TBV6KPZ58V6121F0BHZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:55.186" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf' gitlab # [ 426.639803] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.134Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"1a6b0f938208a99477a10e66","created_at":"2026-08-11T10:14:51.426Z","trace_propagation_headers":{"sentry-trace":"00f997dbcb5246f4995cbbb9a88d4162-c73b910bf441484d","baggage":"sentry-trace_id=00f997dbcb5246f4995cbbb9a88d4162,sentry-release=Unknown"},"correlation_id":"01KZR501HTGSPXQH5M3817ZTT8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.436Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-1a6b0f938208a99477a10e66: done: 0.073162 sec","job_status":"done","queue_duration_s":3.624181,"scheduling_latency_s":3.624202,"redis_calls":14,"redis_duration_s":0.004556999999999999,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000349,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002361,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001847,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00094592,"duration_s":0.073162,"completed_at":"2026-08-11T10:14:55.134Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018881,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 426.686555] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.136Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"049fed31ab96c3a1beab7ce5","created_at":"2026-08-11T10:14:51.764Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-d4ce1252504346e6","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.775Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-049fed31ab96c3a1beab7ce5: start","job_status":"start","queue_duration_s":3.360912,"scheduling_latency_s":3.360936} gitlab # [ 426.701812] gitaly[922]: time="2026-08-11T10:14:55.209Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52TBV6KPZ58V6121F0BHZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:14:55.186" grpc.time_ms=22.226 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 426.715863] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.202Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"049fed31ab96c3a1beab7ce5","created_at":"2026-08-11T10:14:51.764Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-d4ce1252504346e6","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:51.775Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-049fed31ab96c3a1beab7ce5: done: 0.066974 sec","job_status":"done","queue_duration_s":3.360912,"scheduling_latency_s":3.360936,"redis_calls":19,"redis_duration_s":0.005515,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000795,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.001228,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002162,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00133,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.013642419999999999,"duration_s":0.066974,"completed_at":"2026-08-11T10:14:55.202Z","load_balancing_strategy":"primary","db_duration_s":0.015066,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf', in 0.09 seconds) (finished: subtest: push delivers the webhook, in 93.29 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses gitlab # [ 426.762572] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.204Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","da139df0301064f122fa4f4b"],"class":"WebHooks::LogExecutionWorker","jid":"3e91ec493cedee7f7f095f87","created_at":"2026-08-11T10:14:53.318Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-110de419eb3b42e4","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:03b94eb1a30abf4e3921ede9d13eb67ecbaa5d38ee0821a865f13a1049735e39","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:53.332Z","job_size_bytes":2593,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-3e91ec493cedee7f7f095f87: start","job_status":"start","queue_duration_s":1.87287,"scheduling_latency_s":1.872896} gitlab # [ 426.780513] gitaly[922]: time="2026-08-11T10:14:55.326Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52TGJPP49RVTBBETB7FNF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:25.025" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:55.325" grpc.time_ms=1.019 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 426.794100] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 381 gitlab # [ 426.796776] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.257Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","da139df0301064f122fa4f4b"],"class":"WebHooks::LogExecutionWorker","jid":"3e91ec493cedee7f7f095f87","created_at":"2026-08-11T10:14:53.318Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-110de419eb3b42e4","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:03b94eb1a30abf4e3921ede9d13eb67ecbaa5d38ee0821a865f13a1049735e39","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:53.332Z","job_size_bytes":2593,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-3e91ec493cedee7f7f095f87: done: 0.052411 sec","job_status":"done","queue_duration_s":1.87287,"scheduling_latency_s":1.872896,"redis_calls":10,"redis_duration_s":0.002133,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000361,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001305,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000467,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025452,"duration_s":0.052411,"completed_at":"2026-08-11T10:14:55.257Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 426.845243] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.258Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"bba8be2504c2d22574c3ab58","created_at":"2026-08-11T10:14:54.053Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-85f4b2f98e5948cc","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:54.059Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-bba8be2504c2d22574c3ab58: start","job_status":"start","queue_duration_s":1.198788,"scheduling_latency_s":1.198809} gitlab # [ 426.861799] nixbot[3512]: INFO: ::ffff:127.0.0.1:45154 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 200 OK gitlab # [ 426.863731] nixbot[3512]: {"ts": "2026-08-11T10:14:55.633Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e1496f12cf8f003731a971b021434c87a6fae7cf \"HTTP/1.1 201 Created\""} gitlab # [ 426.866715] nixbot[3512]: {"ts": "2026-08-11T10:14:55.642Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-e1496f12cf8f-4"} gitlab # [ 426.870209] gitaly[922]: time="2026-08-11T10:14:55.349Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=593 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR52TGJPP49RVTBBETB7FNF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-11T10:15:25.036" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:55.336" grpc.time_ms=12.965 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 426.884771] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.607Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"bba8be2504c2d22574c3ab58","created_at":"2026-08-11T10:14:54.053Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-85f4b2f98e5948cc","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:54.059Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3459,"job_status":"rescheduled","message":"PipelineProcessWorker JID-bba8be2504c2d22574c3ab58: rescheduled"} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses, in 0.19 seconds) gitlab # [ 426.900178] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.615Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"bba8be2504c2d22574c3ab58","created_at":"2026-08-11T10:14:54.053Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-85f4b2f98e5948cc","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:54.059Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-bba8be2504c2d22574c3ab58: done: 0.357062 sec","job_status":"done","queue_duration_s":1.198788,"scheduling_latency_s":1.198809,"gitaly_calls":3,"gitaly_duration_s":0.156436,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.013567,"redis_read_bytes":150,"redis_write_bytes":18012,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000607,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001547,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003202,"redis_queues_read_bytes":28,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.005431,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000282,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000367,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001524,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.141497,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.30669888,"duration_s":0.357062,"completed_at":"2026-08-11T10:14:55.615Z","load_balancing_strategy":"primary","db_duration_s":0.047562,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 426.952410] nix-daemon[3730]: accepted connection from pid 4390, user nixbot gitlab # [ 426.953352] nix-daemon[3730]: accepted connection from pid 4401, user nixbot gitlab # [ 426.954298] gitaly[922]: time="2026-08-11T10:14:55.366Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KZR52TGJPP49RVTBBETB7FNF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:15:05.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:55.358" grpc.time_ms=8.167 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 426.968046] gitaly[922]: time="2026-08-11T10:14:55.388Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR52S2WW61XX1MR9865AT87 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:14:55.387" grpc.time_ms=0.475 pid=922 span.kind=server system=grpc gitlab # [ 426.977399] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.617Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","304a275be05bc102a319ec22"],"class":"WebHooks::LogExecutionWorker","jid":"757f16b8e570e47cc69341f0","created_at":"2026-08-11T10:14:54.482Z","trace_propagation_headers":{"sentry-trace":"fa3a9b5992c54c41bcf4e1858ed61780-343a927f56a84684","baggage":"sentry-trace_id=fa3a9b5992c54c41bcf4e1858ed61780,sentry-release=Unknown"},"correlation_id":"01KZR50038472JPBB18WAEY4D9","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:72ad39f77cf7226c780294f6b39d1907ca2d5c8925bace694a34608db77bf27a","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:54.486Z","job_size_bytes":2592,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-757f16b8e570e47cc69341f0: start","job_status":"start","queue_duration_s":1.13076,"scheduling_latency_s":1.130817} gitlab # [ 426.994339] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.649Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","304a275be05bc102a319ec22"],"class":"WebHooks::LogExecutionWorker","jid":"757f16b8e570e47cc69341f0","created_at":"2026-08-11T10:14:54.482Z","trace_propagation_headers":{"sentry-trace":"fa3a9b5992c54c41bcf4e1858ed61780-343a927f56a84684","baggage":"sentry-trace_id=fa3a9b5992c54c41bcf4e1858ed61780,sentry-release=Unknown"},"correlation_id":"01KZR50038472JPBB18WAEY4D9","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:72ad39f77cf7226c780294f6b39d1907ca2d5c8925bace694a34608db77bf27a","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:54.486Z","job_size_bytes":2592,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-757f16b8e570e47cc69341f0: done: 0.0324 sec","job_status":"done","queue_duration_s":1.13076,"scheduling_latency_s":1.130817,"redis_calls":7,"redis_duration_s":0.001977,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001494,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000483,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0324,"completed_at":"2026-08-11T10:14:55.649Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009786,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 427.037396] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 104 gitlab # [ 427.039948] nixbot[3512]: {"ts": "2026-08-11T10:14:55.817Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-e1496f12cf8f-4", "argv0": "bwrap"} gitlab # [ 427.042508] gitaly[922]: time="2026-08-11T10:14:55.402Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR52TGJPP49RVTBBETB7FNF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T10:15:05.051" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:14:55.401" grpc.time_ms=0.294 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.053434] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.651Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6f8cc817eecac3dc0f261a5f","created_at":"2026-08-11T10:14:55.179Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-48f8a2ffd339462d","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.188Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6f8cc817eecac3dc0f261a5f: start","job_status":"start","queue_duration_s":0.463696,"scheduling_latency_s":0.463716} gitlab # [ 427.070642] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.761Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6f8cc817eecac3dc0f261a5f","created_at":"2026-08-11T10:14:55.179Z","trace_propagation_headers":{"sentry-trace":"65883d77bf8b431e921cf3188d6e8f43-48f8a2ffd339462d","baggage":"sentry-trace_id=65883d77bf8b431e921cf3188d6e8f43,sentry-release=Unknown"},"correlation_id":"01KZR4ZTTC42HX6G61SCNTY17E","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.188Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6f8cc817eecac3dc0f261a5f: done: 0.109941 sec","job_status":"done","queue_duration_s":0.463696,"scheduling_latency_s":0.463716,"redis_calls":11,"redis_duration_s":0.002824,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000781,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001603,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021386,"duration_s":0.109941,"completed_at":"2026-08-11T10:14:55.761Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025469,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 427.117281] gitaly[922]: time="2026-08-11T10:14:55.421Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52TGJPP49RVTBBETB7FNF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T10:15:05.062" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:55.413" grpc.time_ms=8.406 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.131435] gitaly[922]: time="2026-08-11T10:14:55.432Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR52S2WW61XX1MR9865AT87 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:14:55.432" grpc.time_ms=0.477 pid=922 span.kind=server system=grpc gitlab # [ 427.141816] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.763Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7f75be410242c0dd38bf4143","created_at":"2026-08-11T10:14:55.331Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.334Z","job_size_bytes":23,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7f75be410242c0dd38bf4143: start","job_status":"start","queue_duration_s":0.428931,"scheduling_latency_s":0.428952} gitlab # [ 427.158581] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.807Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7f75be410242c0dd38bf4143","created_at":"2026-08-11T10:14:55.331Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.334Z","job_size_bytes":23,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7f75be410242c0dd38bf4143: done: 0.044473 sec","job_status":"done","queue_duration_s":0.428931,"scheduling_latency_s":0.428952,"redis_calls":7,"redis_duration_s":0.00193,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001593,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000337,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044473,"completed_at":"2026-08-11T10:14:55.807Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007563,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 427.202552] gitaly[922]: time="2026-08-11T10:14:55.454Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR52TGJPP49RVTBBETB7FNF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:14:55.454" grpc.time_ms=0.36 pid=922 span.kind=server system=grpc gitlab # [ 427.212608] gitaly[922]: time="2026-08-11T10:14:55.472Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR52S2WW61XX1MR9865AT87 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:14:55.471" grpc.time_ms=1.033 pid=922 span.kind=server system=grpc gitlab # [ 427.222519] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.811Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bbe7918be2fa2b5485881999","created_at":"2026-08-11T10:14:55.488Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.491Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bbe7918be2fa2b5485881999: start","job_status":"start","queue_duration_s":0.320692,"scheduling_latency_s":0.320715} gitlab # [ 427.239923] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.846Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bbe7918be2fa2b5485881999","created_at":"2026-08-11T10:14:55.488Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.491Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bbe7918be2fa2b5485881999: done: 0.034209 sec","job_status":"done","queue_duration_s":0.320692,"scheduling_latency_s":0.320715,"redis_calls":7,"redis_duration_s":0.006452,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005574,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034209,"completed_at":"2026-08-11T10:14:55.846Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004817,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 427.284350] gitaly[922]: time="2026-08-11T10:14:55.476Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR52TGJPP49RVTBBETB7FNF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T10:14:55.475" grpc.time_ms=0.423 pid=922 span.kind=server system=grpc gitlab # [ 427.294076] gitaly[922]: time="2026-08-11T10:14:55.483Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR52S2WW61XX1MR9865AT87 diskcache=4956628a-97f3-4ed7-b82d-05dd94197f5e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:15:25.042" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:55.343" pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.304219] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.847Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"84256933414775129d8d172e","created_at":"2026-08-11T10:14:55.498Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.502Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-84256933414775129d8d172e: start","job_status":"start","queue_duration_s":0.344741,"scheduling_latency_s":0.34476} gitlab # [ 427.320339] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.877Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"84256933414775129d8d172e","created_at":"2026-08-11T10:14:55.498Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.502Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-84256933414775129d8d172e: done: 0.030615 sec","job_status":"done","queue_duration_s":0.344741,"scheduling_latency_s":0.34476,"redis_calls":7,"redis_duration_s":0.00155,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000441,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030615,"completed_at":"2026-08-11T10:14:55.877Z","load_balancing_strategy":"primary","db_duration_s":0.006192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 427.362709] gitaly[922]: time="2026-08-11T10:14:55.483Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=125 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7102 command.oublock=0 command.real_time_ms=134 command.spawn_token_fork_ms=1 command.system_time_ms=78 command.user_time_ms=47 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52S2WW61XX1MR9865AT87 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T10:15:25.042" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:14:55.343" grpc.time_ms=140.485 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.376466] nix-daemon[3730]: accepted connection from pid 4412, user nixbot gitlab # [ 427.377417] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.879Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"cee5763246f6c3765e83eaab","created_at":"2026-08-11T10:14:55.496Z","trace_propagation_headers":{"sentry-trace":"ce90b4f40bb74d8887afed9459e02b68-fe83d1d35cae4bee","baggage":"sentry-trace_id=ce90b4f40bb74d8887afed9459e02b68,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR52TGJPP49RVTBBETB7FNF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.502Z","job_size_bytes":65,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-cee5763246f6c3765e83eaab: start","job_status":"start","queue_duration_s":0.376912,"scheduling_latency_s":0.37693} gitlab # [ 427.394483] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.913Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"cee5763246f6c3765e83eaab","created_at":"2026-08-11T10:14:55.496Z","trace_propagation_headers":{"sentry-trace":"ce90b4f40bb74d8887afed9459e02b68-fe83d1d35cae4bee","baggage":"sentry-trace_id=ce90b4f40bb74d8887afed9459e02b68,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR52TGJPP49RVTBBETB7FNF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.502Z","job_size_bytes":65,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-cee5763246f6c3765e83eaab: done: 0.033959 sec","job_status":"done","queue_duration_s":0.376912,"scheduling_latency_s":0.37693,"redis_calls":7,"redis_duration_s":0.002051,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001496,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000555,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033959,"completed_at":"2026-08-11T10:14:55.913Z","load_balancing_strategy":"primary","db_duration_s":0.008648,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 427.437947] gitaly[922]: time="2026-08-11T10:14:55.484Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR52TGJPP49RVTBBETB7FNF diskcache=43a890c7-9831-496d-99ed-2ea28eb3040b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:15:05.073" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:14:55.423" pid=922 ref=refs/keep-around/e1496f12cf8f003731a971b021434c87a6fae7cf remote_ip="2001:db8:1::1" revision=e1496f12cf8f003731a971b021434c87a6fae7cf span.kind=server system=grpc username=root gitlab # [ 427.449330] nix-daemon[3730]: accepted connection from pid 4422, user nixbot gitlab # [ 427.450285] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.914Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d3b5d77c42d0cf9d81c83447","created_at":"2026-08-11T10:14:55.503Z","trace_propagation_headers":{"sentry-trace":"ce90b4f40bb74d8887afed9459e02b68-fe83d1d35cae4bee","baggage":"sentry-trace_id=ce90b4f40bb74d8887afed9459e02b68,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR52TGJPP49RVTBBETB7FNF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.507Z","job_size_bytes":65,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d3b5d77c42d0cf9d81c83447: start","job_status":"start","queue_duration_s":0.407738,"scheduling_latency_s":0.407756} gitlab # [ 427.468040] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.990Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d3b5d77c42d0cf9d81c83447","created_at":"2026-08-11T10:14:55.503Z","trace_propagation_headers":{"sentry-trace":"ce90b4f40bb74d8887afed9459e02b68-fe83d1d35cae4bee","baggage":"sentry-trace_id=ce90b4f40bb74d8887afed9459e02b68,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR52TGJPP49RVTBBETB7FNF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.507Z","job_size_bytes":65,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d3b5d77c42d0cf9d81c83447: done: 0.076052 sec","job_status":"done","queue_duration_s":0.407738,"scheduling_latency_s":0.407756,"redis_calls":10,"redis_duration_s":0.0036230000000000004,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001915,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001708,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076052,"completed_at":"2026-08-11T10:14:55.990Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026787,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 427.514123] gitaly[922]: time="2026-08-11T10:14:55.485Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=51 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5109 command.oublock=8 command.real_time_ms=55 command.spawn_token_fork_ms=0 command.system_time_ms=25 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52TGJPP49RVTBBETB7FNF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T10:15:05.073" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T10:14:55.423" grpc.time_ms=60.896 pid=922 ref=refs/keep-around/e1496f12cf8f003731a971b021434c87a6fae7cf remote_ip="2001:db8:1::1" revision=e1496f12cf8f003731a971b021434c87a6fae7cf span.kind=server system=grpc username=root gitlab # [ 427.529627] nix-daemon[3730]: accepted connection from pid 4429, user nixbot gitlab # [ 427.530564] nix-daemon[3730]: accepted connection from pid 4412, user nixbot gitlab # [ 427.531522] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:55.994Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4b2bc8bcff83604e8dfd7eef","created_at":"2026-08-11T10:14:55.510Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.512Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4b2bc8bcff83604e8dfd7eef: start","job_status":"start","queue_duration_s":0.482495,"scheduling_latency_s":0.48254} gitlab # [ 427.548194] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.068Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4b2bc8bcff83604e8dfd7eef","created_at":"2026-08-11T10:14:55.510Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.512Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4b2bc8bcff83604e8dfd7eef: done: 0.074307 sec","job_status":"done","queue_duration_s":0.482495,"scheduling_latency_s":0.48254,"redis_calls":10,"redis_duration_s":0.004233,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001855,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001612,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000766,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.074307,"completed_at":"2026-08-11T10:14:56.068Z","load_balancing_strategy":"primary","db_duration_s":0.010112,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 427.593216] gitaly[922]: time="2026-08-11T10:14:55.489Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52TGJPP49RVTBBETB7FNF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:25.188" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:55.489" grpc.time_ms=0.373 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.606642] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.071Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5b17c0fff63ea80e9fe9c9c2","created_at":"2026-08-11T10:14:55.512Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.514Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5b17c0fff63ea80e9fe9c9c2: start","job_status":"start","queue_duration_s":0.557072,"scheduling_latency_s":0.557112} gitlab # [ 427.623778] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.123Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5b17c0fff63ea80e9fe9c9c2","created_at":"2026-08-11T10:14:55.512Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.514Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5b17c0fff63ea80e9fe9c9c2: done: 0.051961 sec","job_status":"done","queue_duration_s":0.557072,"scheduling_latency_s":0.557112,"redis_calls":7,"redis_duration_s":0.0022789999999999998,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001633,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000646,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051961,"completed_at":"2026-08-11T10:14:56.123Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008146,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 427.667470] gitaly[922]: time="2026-08-11T10:14:55.542Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR52S2WW61XX1MR9865AT87 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:15:25.237" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:55.537" grpc.time_ms=5.157 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.680779] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.125Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9a33a08c54f7088240006f30","created_at":"2026-08-11T10:14:55.515Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.517Z","job_size_bytes":19,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9a33a08c54f7088240006f30: start","job_status":"start","queue_duration_s":0.607874,"scheduling_latency_s":0.607906} gitlab # [ 427.697185] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.165Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9a33a08c54f7088240006f30","created_at":"2026-08-11T10:14:55.515Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.517Z","job_size_bytes":19,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9a33a08c54f7088240006f30: done: 0.039772 sec","job_status":"done","queue_duration_s":0.607874,"scheduling_latency_s":0.607906,"redis_calls":8,"redis_duration_s":0.001911,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001429,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039772,"completed_at":"2026-08-11T10:14:56.165Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007515,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 427.741633] gitaly[922]: time="2026-08-11T10:14:55.585Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52S2WW61XX1MR9865AT87 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:25.284" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:55.584" grpc.time_ms=0.687 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.754378] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.167Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c7532a45f292998480271406","created_at":"2026-08-11T10:14:55.518Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.520Z","job_size_bytes":66,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c7532a45f292998480271406: start","job_status":"start","queue_duration_s":0.646601,"scheduling_latency_s":0.646629} gitlab # [ 427.771890] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.205Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c7532a45f292998480271406","created_at":"2026-08-11T10:14:55.518Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.520Z","job_size_bytes":66,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c7532a45f292998480271406: done: 0.038811 sec","job_status":"done","queue_duration_s":0.646601,"scheduling_latency_s":0.646629,"redis_calls":7,"redis_duration_s":0.001961,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001521,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038811,"completed_at":"2026-08-11T10:14:56.205Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004876,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 427.815605] gitaly[922]: time="2026-08-11T10:14:55.749Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52TXZSP5C8M53RAVKN48A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:25.248" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:55.749" grpc.time_ms=0.656 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.828648] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.207Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"0ec4e704a1c348222e1d7dce","created_at":"2026-08-11T10:14:55.521Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.522Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0ec4e704a1c348222e1d7dce: start","job_status":"start","queue_duration_s":0.684748,"scheduling_latency_s":0.684772} gitlab # [ 427.844870] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.257Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"0ec4e704a1c348222e1d7dce","created_at":"2026-08-11T10:14:55.521Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.522Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0ec4e704a1c348222e1d7dce: done: 0.049911 sec","job_status":"done","queue_duration_s":0.684748,"scheduling_latency_s":0.684772,"redis_calls":7,"redis_duration_s":0.002405,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001481,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049911,"completed_at":"2026-08-11T10:14:56.257Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00852,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 427.887047] gitaly[922]: time="2026-08-11T10:14:56.529Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR52TGJPP49RVTBBETB7FNF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T10:15:26.227" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:56.527" grpc.time_ms=1.467 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.899685] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.263Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"caf578777b3d33e00dd97726","created_at":"2026-08-11T10:14:55.523Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.524Z","job_size_bytes":6,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-caf578777b3d33e00dd97726: start","job_status":"start","queue_duration_s":0.739031,"scheduling_latency_s":0.739081} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses gitlab # [ 427.915674] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.307Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"caf578777b3d33e00dd97726","created_at":"2026-08-11T10:14:55.523Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.524Z","job_size_bytes":6,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-caf578777b3d33e00dd97726: done: 0.043229 sec","job_status":"done","queue_duration_s":0.739031,"scheduling_latency_s":0.739081,"redis_calls":7,"redis_duration_s":0.008780000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008051,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000729,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043229,"completed_at":"2026-08-11T10:14:56.306Z","load_balancing_strategy":"primary","db_duration_s":0.003795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 427.958239] gitaly[922]: time="2026-08-11T10:14:56.616Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52TGJPP49RVTBBETB7FNF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:26.314" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:56.615" grpc.time_ms=1.431 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 427.969636] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"59ad0db1356c6a2f42cf0471","created_at":"2026-08-11T10:14:55.525Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.526Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-59ad0db1356c6a2f42cf0471: start","job_status":"start","queue_duration_s":0.782903,"scheduling_latency_s":0.782937} gitlab # [ 427.983658] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.350Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"59ad0db1356c6a2f42cf0471","created_at":"2026-08-11T10:14:55.525Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.526Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-59ad0db1356c6a2f42cf0471: done: 0.041132 sec","job_status":"done","queue_duration_s":0.782903,"scheduling_latency_s":0.782937,"redis_calls":7,"redis_duration_s":0.001985,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001456,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000529,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041132,"completed_at":"2026-08-11T10:14:56.350Z","load_balancing_strategy":"primary","db_duration_s":0.005094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 428.025663] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.352Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5456122f263043a43e8b1f31","created_at":"2026-08-11T10:14:55.607Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.609Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5456122f263043a43e8b1f31: start","job_status":"start","queue_duration_s":0.742624,"scheduling_latency_s":0.742649} gitlab # [ 428.041375] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.397Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5456122f263043a43e8b1f31","created_at":"2026-08-11T10:14:55.607Z","trace_propagation_headers":{"sentry-trace":"1ed402fc2e434a09a6193950daff7cab-f3a9ca3d923f4e16","baggage":"sentry-trace_id=1ed402fc2e434a09a6193950daff7cab,sentry-release=Unknown"},"correlation_id":"01KZR52S2WW61XX1MR9865AT87","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.609Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5456122f263043a43e8b1f31: done: 0.045178 sec","job_status":"done","queue_duration_s":0.742624,"scheduling_latency_s":0.742649,"redis_calls":8,"redis_duration_s":0.0036279999999999997,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003243,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000385,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045178,"completed_at":"2026-08-11T10:14:56.397Z","load_balancing_strategy":"primary","db_duration_s":0.005456,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 428.083701] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.399Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d6aebc65ebee77c8ee864d25","created_at":"2026-08-11T10:14:55.610Z","trace_propagation_headers":{"sentry-trace":"ce90b4f40bb74d8887afed9459e02b68-fe83d1d35cae4bee","baggage":"sentry-trace_id=ce90b4f40bb74d8887afed9459e02b68,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR52TGJPP49RVTBBETB7FNF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.614Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d6aebc65ebee77c8ee864d25: start","job_status":"start","queue_duration_s":0.784194,"scheduling_latency_s":0.784217} gitlab # [ 428.099950] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.639Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"d6aebc65ebee77c8ee864d25","created_at":"2026-08-11T10:14:55.610Z","trace_propagation_headers":{"sentry-trace":"ce90b4f40bb74d8887afed9459e02b68-fe83d1d35cae4bee","baggage":"sentry-trace_id=ce90b4f40bb74d8887afed9459e02b68,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR52TGJPP49RVTBBETB7FNF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:55.614Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d6aebc65ebee77c8ee864d25: done: 0.240769 sec","job_status":"done","queue_duration_s":0.784194,"scheduling_latency_s":0.784217,"gitaly_calls":2,"gitaly_duration_s":0.011319,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.010557,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001509,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001985,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000451,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002384,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000442,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000899,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001378,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":28,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.172404,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19468646,"duration_s":0.240769,"completed_at":"2026-08-11T10:14:56.639Z","load_balancing_strategy":"primary","db_duration_s":0.05988,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 428.152982] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.642Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"0318c510251df0046a136216","created_at":"2026-08-11T10:14:56.505Z","trace_propagation_headers":{"sentry-trace":"ce90b4f40bb74d8887afed9459e02b68-dad3796cc34142c5","baggage":"sentry-trace_id=ce90b4f40bb74d8887afed9459e02b68,sentry-release=Unknown"},"correlation_id":"01KZR52TGJPP49RVTBBETB7FNF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:56.508Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0318c510251df0046a136216: start","job_status":"start","queue_duration_s":0.134678,"scheduling_latency_s":0.134716} gitlab # [ 428.169027] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:14:56.715Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"0318c510251df0046a136216","created_at":"2026-08-11T10:14:56.505Z","trace_propagation_headers":{"sentry-trace":"ce90b4f40bb74d8887afed9459e02b68-dad3796cc34142c5","baggage":"sentry-trace_id=ce90b4f40bb74d8887afed9459e02b68,sentry-release=Unknown"},"correlation_id":"01KZR52TGJPP49RVTBBETB7FNF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T10:14:56.508Z","job_size_bytes":3,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0318c510251df0046a136216: done: 0.072323 sec","job_status":"done","queue_duration_s":0.134678,"scheduling_latency_s":0.134716,"redis_calls":7,"redis_duration_s":0.002715,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001994,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000721,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.072323,"completed_at":"2026-08-11T10:14:56.715Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017419,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses, in 0.27 seconds) gitlab # [ 428.211211] gitaly[922]: time="2026-08-11T10:14:57.011Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52W4D236R539NR4KG1PW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:27.008" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:57.009" grpc.time_ms=1.389 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 428.224443] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 157 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses gitlab # [ 429.379487] gitaly[922]: time="2026-08-11T10:14:58.232Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52XASK72CXH5363JWT8BD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:28.229" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:58.230" grpc.time_ms=1.49 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 429.429388] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 144 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses, in 0.21 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses gitlab # [ 430.620723] gitaly[922]: time="2026-08-11T10:14:59.473Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52YGDZJ7DY0JNCPT3WBG6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:29.271" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:14:59.472" grpc.time_ms=1.384 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 430.690993] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:14:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 202 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses, in 0.26 seconds) gitlab # [ 431.486411] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:00.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0158a4fc189ce32450225419","created_at":"2026-08-11T10:15:00.305Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29a3b378db49e72cd34ffa4732f96ef0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.335Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0158a4fc189ce32450225419: start","job_status":"start","queue_duration_s":0.003397,"scheduling_latency_s":0.003463} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses gitlab # [ 431.630514] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:00.483Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"0158a4fc189ce32450225419","created_at":"2026-08-11T10:15:00.305Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29a3b378db49e72cd34ffa4732f96ef0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.335Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-0158a4fc189ce32450225419: done: 0.144874 sec","job_status":"done","queue_duration_s":0.003397,"scheduling_latency_s":0.003463,"redis_calls":11,"redis_duration_s":0.024617,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002335,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.014616,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007666,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00227282,"exclusive_lock_hold_duration_s":0.03266234,"duration_s":0.144874,"completed_at":"2026-08-11T10:15:00.483Z","load_balancing_strategy":"primary","db_duration_s":0.023914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 431.722095] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:00.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"3ba08f0a3dbff9504277e35f","created_at":"2026-08-11T10:15:00.347Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"beecef592dd8ccfd7f8c19dc2e533334","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:15:00.361Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-3ba08f0a3dbff9504277e35f: start","job_status":"start","queue_duration_s":0.127891,"scheduling_latency_s":0.127942} gitlab # [ 431.796237] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:00.649Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"3ba08f0a3dbff9504277e35f","created_at":"2026-08-11T10:15:00.347Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"beecef592dd8ccfd7f8c19dc2e533334","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T10:15:00.361Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-3ba08f0a3dbff9504277e35f: done: 0.159978 sec","job_status":"done","queue_duration_s":0.127891,"scheduling_latency_s":0.127942,"redis_calls":9,"redis_duration_s":0.017780999999999998,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002607,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011574,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0036,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.159978,"completed_at":"2026-08-11T10:15:00.649Z","load_balancing_strategy":"primary","db_duration_s":0.051,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 431.872629] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:00.658Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"becbdc8000ba664ca35a859a","created_at":"2026-08-11T10:15:00.372Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9b0928e4935ec0d3711bf6b18862876","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.403Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-becbdc8000ba664ca35a859a: start","job_status":"start","queue_duration_s":0.254667,"scheduling_latency_s":0.254721} gitlab # [ 431.889361] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:00.719Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses, in 0.20 seconds) gitlab # [ 431.893131] gitaly[922]: time="2026-08-11T10:15:00.695Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=1 command.spawn_token_fork_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR52ZQE3WM2YK27G8NMYZ7N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:30.685" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:15:00.685" grpc.time_ms=8.858 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 431.906962] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:15:00 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 153 gitlab # [ 431.909767] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:00.753Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"becbdc8000ba664ca35a859a","created_at":"2026-08-11T10:15:00.372Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9b0928e4935ec0d3711bf6b18862876","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.403Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-becbdc8000ba664ca35a859a: done: 0.095481 sec","job_status":"done","queue_duration_s":0.254667,"scheduling_latency_s":0.254721,"redis_calls":9,"redis_duration_s":0.005055,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000771,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003391,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.095481,"completed_at":"2026-08-11T10:15:00.753Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 431.953487] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:00.777Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"59c127779e544cce35a3546b","created_at":"2026-08-11T10:15:00.442Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ad68145ec4d0cbcd8e2a0530c41baf9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.512Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-59c127779e544cce35a3546b: start","job_status":"start","queue_duration_s":0.265531,"scheduling_latency_s":0.265587} gitlab # [ 432.131759] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:00.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"59c127779e544cce35a3546b","created_at":"2026-08-11T10:15:00.442Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ad68145ec4d0cbcd8e2a0530c41baf9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.512Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-59c127779e544cce35a3546b: done: 0.206958 sec","job_status":"done","queue_duration_s":0.265531,"scheduling_latency_s":0.265587,"redis_calls":12,"redis_duration_s":0.031317,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014692,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.014347,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02443652,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.206958,"completed_at":"2026-08-11T10:15:00.984Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011186,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 432.232139] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:00.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4797733ede3bbe927d6d11fb","created_at":"2026-08-11T10:15:00.559Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"968809e15c850b46912287a82b4a1fb1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.601Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4797733ede3bbe927d6d11fb: start","job_status":"start","queue_duration_s":0.392262,"scheduling_latency_s":0.392312} gitlab # [ 432.469812] gitaly[922]: time="2026-08-11T10:15:01.323Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR530AS65V0DV2FVX1BWE0A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:31.121" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:15:01.322" grpc.time_ms=1.436 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 432.576799] gitaly[922]: time="2026-08-11T10:15:01.431Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR530AS65V0DV2FVX1BWE0A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:15:11.061" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:15:01.412" grpc.time_ms=18.522 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 432.629550] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:01.481Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4797733ede3bbe927d6d11fb","created_at":"2026-08-11T10:15:00.559Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"968809e15c850b46912287a82b4a1fb1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.601Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4797733ede3bbe927d6d11fb: done: 0.487948 sec","job_status":"done","queue_duration_s":0.392262,"scheduling_latency_s":0.392312,"redis_calls":11,"redis_duration_s":0.02451,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003943,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009571,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.010996,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.064,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.064,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.103484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0035565,"exclusive_lock_hold_duration_s":0.12356734,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.487948,"completed_at":"2026-08-11T10:15:01.481Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.086618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 432.712958] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:01.487Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"632ddbf7b8d34fc1a75ab091","created_at":"2026-08-11T10:15:00.630Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41f32d8aa1255638607f2864a78336d0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:15:00.655Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-632ddbf7b8d34fc1a75ab091: start","job_status":"start","queue_duration_s":0.832249,"scheduling_latency_s":0.832302} gitlab # [ 432.728815] nixbot[3512]: {"ts": "2026-08-11T10:15:01.531Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e1496f12cf8f003731a971b021434c87a6fae7cf \"HTTP/1.1 201 Created\""} gitlab # [ 432.731847] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:15:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 319 gitlab # [ 432.742603] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:01.596Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 432.764895] gitaly[922]: time="2026-08-11T10:15:01.619Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR530N1Y09FXCNRGXZCC59Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:31.617" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:15:01.618" grpc.time_ms=1.014 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 432.784073] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:01.621Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"632ddbf7b8d34fc1a75ab091","created_at":"2026-08-11T10:15:00.630Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41f32d8aa1255638607f2864a78336d0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T10:15:00.655Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-632ddbf7b8d34fc1a75ab091: done: 0.133675 sec","job_status":"done","queue_duration_s":0.832249,"scheduling_latency_s":0.832302,"redis_calls":9,"redis_duration_s":0.016357,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004059,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008182,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004116,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.133675,"completed_at":"2026-08-11T10:15:01.621Z","load_balancing_strategy":"primary","db_duration_s":0.026891,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 432.831987] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:01.642Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"aea98a40794d9909ec14cf9d","created_at":"2026-08-11T10:15:00.710Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db7169685cc0b9ca65bdddb6db3d6f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.747Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-aea98a40794d9909ec14cf9d: start","job_status":"start","queue_duration_s":0.894579,"scheduling_latency_s":0.894625} gitlab # [ 432.850643] gitaly[922]: time="2026-08-11T10:15:01.704Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR530N1Y09FXCNRGXZCC59Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:15:11.260" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:15:01.692" grpc.time_ms=12.717 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses gitlab # [ 432.938077] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:15:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 253 gitlab # [ 432.944555] nixbot[3512]: {"ts": "2026-08-11T10:15:01.793Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e1496f12cf8f003731a971b021434c87a6fae7cf \"HTTP/1.1 201 Created\""} gitlab # [ 433.013127] gitaly[922]: time="2026-08-11T10:15:01.865Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR530XE9V6NJEJCE0Y1X3QE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:31.863" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:15:01.864" grpc.time_ms=0.87 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 433.048907] gitaly[922]: time="2026-08-11T10:15:01.902Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR530XXVWHC03XETQCF2ZYA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:31.700" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:15:01.901" grpc.time_ms=0.964 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses, in 0.18 seconds) gitlab # [ 433.076073] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:15:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses HTTP/1.1" 200 1307 "" "curl/8.21.0" 97 gitlab # [ 433.104234] gitaly[922]: time="2026-08-11T10:15:01.958Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR530XXVWHC03XETQCF2ZYA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T10:15:11.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T10:15:01.940" grpc.time_ms=17.737 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 433.187186] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:15:02 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e1496f12cf8f003731a971b021434c87a6fae7cf HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 219 gitlab # [ 433.190066] nixbot[3512]: {"ts": "2026-08-11T10:15:02.043Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e1496f12cf8f003731a971b021434c87a6fae7cf \"HTTP/1.1 201 Created\""} gitlab # [ 433.283673] nix-daemon[3730]: accepted connection from pid 4486, user nixbot gitlab # [ 433.403770] gitaly[922]: time="2026-08-11T10:15:02.258Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR5319DXQSJ0MZBQYC6E0SX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:15:02.248" grpc.time_ms=9.55 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 433.438345] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:15:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 68 gitlab # [ 433.445201] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.298Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"aea98a40794d9909ec14cf9d","created_at":"2026-08-11T10:15:00.710Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db7169685cc0b9ca65bdddb6db3d6f7c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.747Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-aea98a40794d9909ec14cf9d: done: 0.656763 sec","job_status":"done","queue_duration_s":0.894579,"scheduling_latency_s":0.894625,"redis_calls":564,"redis_duration_s":0.13394899999999998,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00076,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.130406,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.525749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.656763,"completed_at":"2026-08-11T10:15:02.298Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003052,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 433.514849] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5326576f9d5958f56d9afa5d","created_at":"2026-08-11T10:15:00.769Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8e4b12691d2e8c4c3404f29abea2e54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.784Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5326576f9d5958f56d9afa5d: start","job_status":"start","queue_duration_s":1.516868,"scheduling_latency_s":1.516904} gitlab # [ 433.530981] gitlab-workhorse[816]: time="2026-08-11T10:15:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 433.533065] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:15:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 94 gitlab # [ 433.535178] gitaly[922]: time="2026-08-11T10:15:02.353Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR531BMW47NBS6K6N0K0QRA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:15:02.341" pid=922 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 433.546068] gitaly[922]: time="2026-08-11T10:15:02.353Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR531BMW47NBS6K6N0K0QRA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:15:02.341" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 433.559922] gitaly[922]: time="2026-08-11T10:15:02.354Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR531BMW47NBS6K6N0K0QRA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T10:15:02.341" grpc.time_ms=12.86 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 433.591282] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.445Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5326576f9d5958f56d9afa5d","created_at":"2026-08-11T10:15:00.769Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8e4b12691d2e8c4c3404f29abea2e54","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.784Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5326576f9d5958f56d9afa5d: done: 0.143803 sec","job_status":"done","queue_duration_s":1.516868,"scheduling_latency_s":1.516904,"redis_calls":70,"redis_duration_s":0.017572,"redis_read_bytes":118,"redis_write_bytes":42530,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00311,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000608,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.012969,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.122685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.143803,"completed_at":"2026-08-11T10:15:02.445Z","load_balancing_strategy":"primary","db_duration_s":0.003666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 433.645868] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.447Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"62e88e4901377a084ccd9739","created_at":"2026-08-11T10:15:00.793Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6bc58451a3cebc531b65b6fd906cc3d0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:15:00.805Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-62e88e4901377a084ccd9739: start","job_status":"start","queue_duration_s":1.641754,"scheduling_latency_s":1.641778} gitlab # [ 433.660152] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.459Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 433.664036] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.467Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"62e88e4901377a084ccd9739","created_at":"2026-08-11T10:15:00.793Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6bc58451a3cebc531b65b6fd906cc3d0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T10:15:00.805Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-62e88e4901377a084ccd9739: done: 0.02022 sec","job_status":"done","queue_duration_s":1.641754,"scheduling_latency_s":1.641778,"redis_calls":9,"redis_duration_s":0.002305,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000524,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001297,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000484,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02022,"completed_at":"2026-08-11T10:15:02.467Z","load_balancing_strategy":"primary","db_duration_s":0.000648,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 433.706828] nix-daemon[3730]: accepted connection from pid 4511, user nixbot gitlab # [ 433.707777] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"9dd5a8784210cdabff50ec29","created_at":"2026-08-11T10:15:00.859Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7331c63c3203e82f92cb6f4bcc528750","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.881Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-9dd5a8784210cdabff50ec29: start","job_status":"start","queue_duration_s":1.58749,"scheduling_latency_s":1.587513} gitlab # [ 433.722719] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.481Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 433.726121] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"9dd5a8784210cdabff50ec29","created_at":"2026-08-11T10:15:00.859Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7331c63c3203e82f92cb6f4bcc528750","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.881Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-9dd5a8784210cdabff50ec29: done: 0.020355 sec","job_status":"done","queue_duration_s":1.58749,"scheduling_latency_s":1.587513,"redis_calls":9,"redis_duration_s":0.002347,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000627,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001268,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000452,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020355,"completed_at":"2026-08-11T10:15:02.489Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000737,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 433.768792] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2a0fe6b7cf80962e6648e773","created_at":"2026-08-11T10:15:00.913Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5561ea023d9976de1f3994bede41271e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.948Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2a0fe6b7cf80962e6648e773: start","job_status":"start","queue_duration_s":1.543201,"scheduling_latency_s":1.543255} gitlab # [ 433.783725] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2a0fe6b7cf80962e6648e773","created_at":"2026-08-11T10:15:00.913Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5561ea023d9976de1f3994bede41271e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.948Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2a0fe6b7cf80962e6648e773: done: 0.042239 sec","job_status":"done","queue_duration_s":1.543201,"scheduling_latency_s":1.543255,"redis_calls":11,"redis_duration_s":0.00412,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000475,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002478,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007276,"exclusive_lock_hold_duration_s":0.00901354,"duration_s":0.042239,"completed_at":"2026-08-11T10:15:02.534Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005888,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 433.827940] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2f2086d922f9bea74a93ce5d","created_at":"2026-08-11T10:15:00.963Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d353dee3199a31d016af68f7a6f9573c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.987Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2f2086d922f9bea74a93ce5d: start","job_status":"start","queue_duration_s":1.548282,"scheduling_latency_s":1.548311} gitlab # [ 433.842805] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.564Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2f2086d922f9bea74a93ce5d","created_at":"2026-08-11T10:15:00.963Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d353dee3199a31d016af68f7a6f9573c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:00.987Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2f2086d922f9bea74a93ce5d: done: 0.028393 sec","job_status":"done","queue_duration_s":1.548282,"scheduling_latency_s":1.548311,"redis_calls":11,"redis_duration_s":0.002471,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000901,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001098,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000472,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028393,"completed_at":"2026-08-11T10:15:02.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 433.886359] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.566Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"5c52cb0716bc523a79f4a9bf","created_at":"2026-08-11T10:15:01.187Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a999cdaee00d6474a965b4d13beaf4c9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:01.204Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-5c52cb0716bc523a79f4a9bf: start","job_status":"start","queue_duration_s":1.361568,"scheduling_latency_s":1.361593} gitlab # [ 433.900861] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.579Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 433.904224] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.588Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"5c52cb0716bc523a79f4a9bf","created_at":"2026-08-11T10:15:01.187Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a999cdaee00d6474a965b4d13beaf4c9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:01.204Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-5c52cb0716bc523a79f4a9bf: done: 0.022129 sec","job_status":"done","queue_duration_s":1.361568,"scheduling_latency_s":1.361593,"redis_calls":9,"redis_duration_s":0.002382,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000552,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001349,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022129,"completed_at":"2026-08-11T10:15:02.588Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 433.945886] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.589Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"aa34e59a044ade8d117f095c","created_at":"2026-08-11T10:15:01.212Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe3af29c94867f84af874787be2890fa","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:01.224Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-aa34e59a044ade8d117f095c: start","job_status":"start","queue_duration_s":1.365861,"scheduling_latency_s":1.365886} gitlab # [ 433.960285] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.622Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"aa34e59a044ade8d117f095c","created_at":"2026-08-11T10:15:01.212Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe3af29c94867f84af874787be2890fa","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:01.224Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-aa34e59a044ade8d117f095c: done: 0.032475 sec","job_status":"done","queue_duration_s":1.365861,"scheduling_latency_s":1.365886,"redis_calls":9,"redis_duration_s":0.002451,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000462,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00057,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032475,"completed_at":"2026-08-11T10:15:02.622Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 434.002349] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:02.624Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4e0807f378e457e830e1dfcb","created_at":"2026-08-11T10:15:01.251Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a058ce575b50c9c69f17826f98ab140b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:01.274Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4e0807f378e457e830e1dfcb: start","job_status":"start","queue_duration_s":1.349848,"scheduling_latency_s":1.349867} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses gitlab # [ 434.148246] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:03.001Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4e0807f378e457e830e1dfcb","created_at":"2026-08-11T10:15:01.251Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a058ce575b50c9c69f17826f98ab140b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:01.274Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4e0807f378e457e830e1dfcb: done: 0.377533 sec","job_status":"done","queue_duration_s":1.349848,"scheduling_latency_s":1.349867,"redis_calls":13,"redis_duration_s":0.004057,"redis_read_bytes":11,"redis_write_bytes":1563,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001012,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001519,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001526,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.064,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.063,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.293185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058394,"exclusive_lock_hold_duration_s":0.34689826,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.377533,"completed_at":"2026-08-11T10:15:03.001Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.097387,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 434.233958] sidekiq-cluster[3459]: {"severity":"INFO","time":"2026-08-11T10:15:03.004Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"5172e734cd175ec032cf2c6d","created_at":"2026-08-11T10:15:01.287Z","trace_propagation_headers":{"sentry-trace":"7871821a29bb437ea0a21d9cfa652c29-f1ef963c5fe64675","baggage":"sentry-trace_id=7871821a29bb437ea0a21d9cfa652c29,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c805022c522fe76c34660cc050ba45f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-11T10:15:01.307Z","job_size_bytes":2,"pid":3459,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-5172e734cd175ec032cf2c6d: start","job_status":"start","queue_duration_s":1.696687,"scheduling_latency_s":1.696715} gitlab # [ 434.250704] gitaly[922]: time="2026-08-11T10:15:03.095Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR5322WEY73X973J9JD2WRT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T10:15:33.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T10:15:03.094" grpc.time_ms=1.343 pid=922 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses, in 0.21 seconds) gitlab # [ 434.282419] gitlab-workhorse[816]: gitlab 2001:db8:1::1 - - [2026/08/11:10:15:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e1496f12cf8f003731a971b021434c87a6fae7cf/statuses HTTP/1.1" 200 1328 "" "curl/8.21.0" 131 (finished: subtest: eval and build post commit statuses, in 7.52 seconds) (finished: run the VM test script, in 505.83 seconds) test script finished in 505.88s cleanup kill QemuMachine (pid 46) gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14) (finished: cleanup, in 1.36 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-11T10:13:21.304Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'e1496f12cf8f003731a971b021434c87a6fae7cf', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-11T10:14:55.238610Z', 'started_at': None, 'finished_at': None}] [{'id': 5, 'sha': 'e1496f12cf8f003731a971b021434c87a6fae7cf', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T10:14:55.599Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'e1496f12cf8f003731a971b021434c87a6fae7cf', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T10:14:55.599Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'e1496f12cf8f003731a971b021434c87a6fae7cf', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T10:14:55.599Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'e1496f12cf8f003731a971b021434c87a6fae7cf', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T10:14:55.599Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'e1496f12cf8f003731a971b021434c87a6fae7cf', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T10:14:55.599Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'e1496f12cf8f003731a971b021434c87a6fae7cf', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-11T10:14:55.599Z', 'started_at': None, 'finished_at': '2026-08-11T10:15:01.480Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'e1496f12cf8f003731a971b021434c87a6fae7cf', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-11T10:15:01.751Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'e1496f12cf8f003731a971b021434c87a6fae7cf', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-11T10:14:55.599Z', 'started_at': None, 'finished_at': '2026-08-11T10:15:01.480Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'e1496f12cf8f003731a971b021434c87a6fae7cf', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-11T10:15:01.751Z', 'started_at': None, 'finished_at': '2026-08-11T10:15:01.996Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]