vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #360
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.JEsrPwo99B', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 0148e889-8386-41a8-a21e-2bd4fbe517f216gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618(finished: start all VMs, in 70.21 seconds)19gitlab # 20gitlab: waiting for unit setup-gitlab.service21gitlab # Allocating group tables: 0/8 done22gitlab: waiting for the VM to finish booting23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1dmv272sfx4ax5sd3xhgs6zvfqsc10vm-nixos-system-gitlab-test/init regInfo=/nix/store/id02avr8hhvay7hbjv93mpysil1vsijr-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/id02avr8hhvay7hbjv93mpysil1vsijr-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000028] arm-pv: using stolen time PV108gitlab # [ 0.000380] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000566] Console: colour dummy device 80x25110gitlab # [ 0.000573] printk: legacy console [tty0] enabled111gitlab # [ 0.000756] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000763] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000839] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.000997] landlock: Up and running.115gitlab # [ 0.000999] Yama: becoming mindful.116gitlab # [ 0.001419] LSM support for eBPF active117gitlab # [ 0.001626] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001736] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002918] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003564] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003568] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003722] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004773] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004865] EFI services will not be available.125gitlab # [ 0.005021] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005660] Detected PIPT I-cache on CPU1127gitlab # [ 0.005759] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005890] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.006017] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007098] Detected PIPT I-cache on CPU2131gitlab # [ 0.007202] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007333] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007458] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008509] Detected PIPT I-cache on CPU3135gitlab # [ 0.008624] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008758] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008886] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009396] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009422] SMP: Total of 4 processors activated.140gitlab # [ 0.009425] CPU: All CPU(s) started at EL1141gitlab # [ 0.009433] CPU features: detected: Branch Target Identification142gitlab # [ 0.009437] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009440] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009443] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009447] CPU features: detected: Common not Private translations146gitlab # [ 0.009450] CPU features: detected: CRC32 instructions147gitlab # [ 0.009452] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009455] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009458] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009461] CPU features: detected: E0PD151gitlab # [ 0.009464] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009467] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009469] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009472] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009475] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009479] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009482] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009485] CPU features: detected: Privileged Access Never159gitlab # [ 0.009487] CPU features: detected: PMUv3160gitlab # [ 0.009490] CPU features: detected: RAS Extension Support161gitlab # [ 0.009492] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009495] CPU features: detected: Random Number Generator163gitlab # [ 0.009497] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009499] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009502] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009505] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009631] alternatives: applying system-wide alternatives168gitlab # [ 0.012398] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012581] Memory: 5963800K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014008] devtmpfs: initialized171gitlab # [ 0.017861] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.017927] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018092] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018096] 0 pages in range for non-PLT usage175gitlab # [ 0.018098] 508288 pages in range for PLT usage176gitlab # [ 0.018212] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019025] DMI not present or invalid.178gitlab # [ 0.022223] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.024976] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025244] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.027093] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.027114] audit: initializing netlink subsys (disabled)183gitlab # [ 0.027412] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.027845] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.027847] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.027852] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.027854] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.027857] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.027934] cpuidle: using governor ladder190gitlab # [ 0.027957] cpuidle: using governor menu191gitlab # [ 0.028148] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.028356] ASID allocator initialised with 65536 entries193gitlab # [ 0.029474] Serial: AMBA PL011 UART driver194gitlab # [ 0.034418] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034714] printk: console [ttyAMA0] enabled196gitlab # [ 0.050582] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.050588] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.050591] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.050594] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.050597] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.050600] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.050607] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.050609] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.062297] fbcon: Taking over console205gitlab # [ 0.062325] ACPI: Interpreter disabled.206gitlab # [ 0.064808] iommu: Default domain type: Translated207gitlab # [ 0.064820] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.090479] SCSI subsystem initialized209gitlab # [ 0.091048] usbcore: registered new interface driver usbfs210gitlab # [ 0.091086] usbcore: registered new interface driver hub211gitlab # [ 0.091112] usbcore: registered new device driver usb212gitlab # [ 0.091565] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.091571] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.091583] PTP clock support registered215gitlab # [ 0.091640] EDAC MC: Ver: 3.0.0216gitlab # [ 0.092124] scmi_core: SCMI protocol bus registered217gitlab # [ 0.092967] FPGA manager framework218gitlab # [ 0.093896] vgaarb: loaded219gitlab # [ 0.095615] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.096438] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.096479] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.097746] netfs: FS-Cache loaded223gitlab # [ 0.097986] pnp: PnP ACPI: disabled224gitlab # [ 0.108265] NET: Registered PF_INET protocol family225gitlab # [ 0.109939] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.149389] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.149445] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.149493] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.149836] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.150508] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.150618] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.150674] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.150809] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.151023] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.151042] NET: Registered PF_XDP protocol family236gitlab # [ 0.151057] PCI: CLS 0 bytes, default 64237gitlab # [ 0.151384] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.152546] kvm [1]: HYP mode not available239gitlab # [ 0.199969] Initialise system trusted keyrings240gitlab # [ 0.200208] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.200799] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.200934] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.213145] Key type asymmetric registered244gitlab # [ 0.213150] Asymmetric key parser 'x509' registered245gitlab # [ 0.213202] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.213393] io scheduler mq-deadline registered247gitlab # [ 0.213397] io scheduler kyber registered248gitlab # [ 0.220027] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.224685] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.225012] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.225025] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.225035] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.225041] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.225060] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.225079] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.225145] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.225152] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.225156] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.225159] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.225162] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.225262] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.225753] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.225970] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.225983] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.226010] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.226022] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.226547] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.226766] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.226784] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.226817] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.227405] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.227636] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.227653] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.227680] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.228188] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.228405] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.228417] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.228449] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.229008] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.229225] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.229237] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.229263] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.229799] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.230009] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.230021] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.230053] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.230588] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.230804] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.230816] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.230848] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.230861] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.231412] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.231653] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.231681] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.232227] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.232435] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.232463] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.232917] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.233123] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.233401] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.233682] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.233694] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.233721] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.234263] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.234475] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.234487] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.234513] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.235156] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.235163] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.235167] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.235209] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.235257] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.235300] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.235353] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.235400] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.235448] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.235498] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.235548] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.235594] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.235685] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.235733] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.235751] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.235774] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.235792] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.235809] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.235828] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.235846] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.235869] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.235889] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.235907] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.235926] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.235945] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.235966] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.235989] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.236006] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.236024] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.236042] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.236059] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.236077] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.236095] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.236113] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.236135] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.236140] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.236143] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.237481] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.249461] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.251736] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.253961] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.256173] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.258287] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.261839] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.266502] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.268765] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.270827] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.272669] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.274801] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.285436] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.287128] msm_serial: driver initialized359gitlab # [ 0.287309] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.287359] STM32 USART driver initialized361gitlab # [ 0.304350] loop: module loaded362gitlab # [ 0.304573] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.306341] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.308178] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.309865] virtio_blk virtio5: [vdb] 12285096 512-byte logical blocks (6.29 GB/5.86 GiB)366gitlab # [ 0.311870] megasas: 07.734.00.00-rc1367gitlab # [ 0.312525] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.315978] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.315992] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.317545] Using buffer write method371gitlab # [ 0.317579] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.319224] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.319240] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.320847] Using buffer write method375gitlab # [ 0.320863] Concatenating MTD devices:376gitlab # [ 0.320865] (0): "0.flash"377gitlab # [ 0.320868] (1): "0.flash"378gitlab # [ 0.320870] into device "0.flash"379gitlab # [ 0.644363] Freeing initrd memory: 27184K380gitlab # [ 0.662942] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.672066] thunder_xcv, ver 1.0382gitlab # [ 0.672154] thunder_bgx, ver 1.0383gitlab # [ 0.672216] nicpf, ver 1.0384gitlab # [ 0.673856] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.673867] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.673934] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.673949] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.674018] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.674027] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.674098] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.674108] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.674483] sky2: driver version 1.30393gitlab # [ 0.679084] ehci-pci 0000:00:0a.0: EHCI Host Controller394gitlab # [ 0.679115] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1395gitlab # [ 0.679407] usbcore: registered new interface driver usb-storage396gitlab # [ 0.679464] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000397gitlab # [ 0.679880] usbcore: registered new interface driver usbserial_generic398gitlab # [ 0.679920] usbserial: USB Serial support registered for generic399gitlab # [ 0.681620] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.684114] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.684171] rtc-pl031 9010000.pl031: setting system clock to 2026-09-09T10:31:04 UTC (1788949864)402gitlab # [ 0.685066] i2c_dev: i2c /dev entries driver403gitlab # [ 0.691664] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.692760] hub 1-0:1.0: USB hub found405gitlab # [ 0.692812] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.693104] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.693117] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.693905] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.695065] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.699647] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.700445] usbcore: registered new interface driver usbhid412gitlab # [ 0.700456] usbhid: USB HID core driver413gitlab # [ 0.739584] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.744392] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.744872] NET: Registered PF_INET6 protocol family416gitlab # [ 0.747485] Segment Routing with IPv6417gitlab # [ 0.747552] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.747799] NET: Registered PF_PACKET protocol family419gitlab # [ 0.748178] 9pnet: Installing 9P2000 support420gitlab # [ 0.753044] Key type dns_resolver registered421gitlab # [ 0.771297] registered taskstats version 1422gitlab # [ 0.771789] Loading compiled-in X.509 certificates423gitlab # [ 0.795352] Demotion targets for Node 0: null424gitlab # [ 0.795567] Key type .fscrypt registered425gitlab # [ 0.795574] Key type fscrypt-provisioning registered426gitlab # [ 0.795785] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.795809] ima: Allocated hash algorithm: sha1428gitlab # [ 0.795870] ima: No architecture policies found429gitlab # [ 0.797085] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.826359] clk: Disabling unused clocks431gitlab # [ 0.826392] PM: genpd: Disabling unused power domains432gitlab # [ 0.832147] Freeing unused kernel memory: 4736K433gitlab # [ 0.832411] Run /init as init process434gitlab # [ 0.873091] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.943706] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.096263] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.184234] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0438gitlab # [ 1.207919] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)439gitlab # [ 1.207985] systemd[1]: Detected virtualization qemu.440gitlab # [ 1.208114] systemd[1]: Detected architecture arm64.441gitlab # [ 1.208131] systemd[1]: Running in initrd.442gitlab # [ 1.208924] systemd[1]: Initializing machine ID from random generator.443gitlab # [ 1.209275] systemd[1]: Hostname set to <gitlab>.444gitlab # [ 1.303720] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.453214] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.458034] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.458397] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.531044] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.547333] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.547597] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.547754] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.547772] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.547802] systemd[1]: Reached target Path Units.454gitlab # [ 1.547821] systemd[1]: Reached target Slice Units.455gitlab # [ 1.547843] systemd[1]: Reached target Swaps.456gitlab # [ 1.547867] systemd[1]: Reached target Timer Units.457gitlab # [ 1.548050] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.548236] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.548422] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.548585] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.548683] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.548704] systemd[1]: Reached target Socket Units.463gitlab # [ 1.550758] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.552720] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.552797] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.554636] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.579993] systemd[1]: Starting Journal Service...468gitlab # [ 1.584306] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.584520] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.587787] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.596242] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.598538] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.599444] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.604500] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.608381] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.616016] systemd-journald[94]: Collecting audit messages is disabled.477gitlab # [ 1.629146] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0478gitlab # [ 1.629680] [drm] features: -virgl +edid -resource_blob -host_visible479gitlab # [ 1.629686] [drm] features: -context_init480gitlab # [ 1.631081] [drm] number of scanouts: 1481gitlab # [ 1.631103] [drm] number of cap sets: 0482gitlab # [ 1.638938] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.483gitlab # [ 1.639145] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic484gitlab # [ 1.639160] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0485gitlab # [ 1.639282] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev486gitlab # [ 1.651150] Console: switching to colour frame buffer device 160x50487gitlab # [ 1.661044] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device488gitlab # [ 1.666119] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.489gitlab # [ 1.669388] systemd[1]: Starting Create Static Device Nodes in /dev...490gitlab # [ 1.672152] systemd[1]: Started Journal Service.491gitlab # [ 1.669187] systemd-modules-load[95]: Using 4 probe threads492gitlab # [ 1.672990] systemd-modules-load[95]: Module 'virtio_balloon' is built in493gitlab # [ 1.674168] systemd-modules-load[95]: Module 'virtio_console' is built in494gitlab # [ 1.675287] systemd-modules-load[95]: Module 'virtio_rng' is built in495gitlab # [ 1.676319] systemd-modules-load[95]: Inserted module 'dm_mod'496gitlab # [ 1.677244] systemd-modules-load[95]: Inserted module 'virtio_gpu'497gitlab # [ 1.680744] systemd[1]: Finished Load Kernel Modules.498gitlab # [ 1.694079] systemd[1]: Starting Apply Kernel Variables...499gitlab # [ 1.695678] systemd[1]: Finished Create Static Device Nodes in /dev.500gitlab # [ 1.697991] systemd[1]: Reached target Preparation for Local File Systems.501gitlab # [ 1.699026] systemd[1]: Reached target Local File Systems.502gitlab # [ 1.704459] systemd[1]: Starting Create System Files and Directories...503gitlab # [ 1.708085] systemd[1]: Starting Rule-based Manager for Device Events and Files...504gitlab # [ 1.717232] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.728912] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.734377] systemd-udevd[113]: Using default interface naming scheme 'v261'.507gitlab # [ 1.747931] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.772663] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.833837] systemd-vconsole-setup[128]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.838705] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.245773] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.248314] systemd[1]: Reached target System Initialization.513gitlab # [ 2.250742] systemd[1]: Reached target Basic System.514gitlab # [ 2.476193] (udev-worker)[133]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.494290] (udev-worker)[139]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.516gitlab # [ 2.500347] (udev-worker)[139]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.507134] systemd[1]: Found device /dev/disk/by-label/nix-store.518gitlab # [ 2.516447] systemd[1]: Found device /dev/disk/by-label/nixos.519gitlab # [ 2.521058] systemd[1]: Reached target Initrd Root Device.520gitlab # [ 2.522630] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...521gitlab # [ 2.567780] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.574324] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.587476] systemd[1]: Mounting /sysroot...524gitlab # [ 2.619954] EXT4-fs (vda): mounted filesystem 0148e889-8386-41a8-a21e-2bd4fbe517f2 r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.622119] systemd[1]: Mounted /sysroot.526gitlab # [ 2.623406] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.626754] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.632278] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.644155] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.645201] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.648977] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.656410] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.657925] systemd[1]: Mounted /sysroot/nix/.rw-store.534gitlab # [ 2.671737] systemd-sysroot-fstab-check[165]: /sysroot should be mounted in the initrd, will request daemon-reload.535gitlab # [ 2.673393] systemd[1]: Starting rw-sysroot-nix-store.service...536gitlab # [ 2.675344] systemd[1]: Mounted /sysroot/run.537gitlab # [ 2.685944] erofs (device vdb): mounted with root inode @ nid 128.538gitlab # [ 2.687408] systemd[1]: Reload requested from client PID 165 ('systemd-sysroot') (unit initrd-parse-etc.service)...539gitlab # [ 2.689985] systemd[1]: Reloading...540gitlab # [ 2.814852] systemd[1]: Reloading finished in 138 ms.541gitlab # [ 2.863096] systemd-sysroot-fstab-check[165]: Requesting initrd-fs.target/start/replace...542gitlab # [ 2.865307] systemd[1]: Mounted /sysroot/nix/.ro-store.543gitlab # [ 2.867276] systemd[1]: Mounted /sysroot/tmp/shared.544gitlab # [ 2.869559] systemd[1]: Mounted /sysroot/tmp/xchg.545gitlab # [ 2.870327] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 2.871970] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 2.873318] systemd-sysroot-fstab-check[165]: Requesting swap.target/start/replace...548gitlab # [ 2.876428] systemd[1]: initrd-parse-etc.service: Deactivated successfully.549gitlab # [ 2.878335] systemd[1]: Finished Mountpoints Configured in the Real Root.550gitlab # [ 2.879334] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.551gitlab # [ 2.880477] systemd[1]: Starting rw-sysroot-nix-store.service...552gitlab # [ 2.904390] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 2.905560] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 3.036545] (udev-worker)[145]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory555gitlab # [ 3.039805] (udev-worker)[145]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory556gitlab # [ 3.051790] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 3.052977] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 3.053719] systemd[1]: Stopping Virtual Console Setup...559gitlab # [ 3.054474] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 3.094576] systemd-vconsole-setup[198]: Configuration of first virtual console was skipped, ignoring remaining ones.561gitlab # [ 3.097035] systemd[1]: Finished Virtual Console Setup.562gitlab # [ 3.592840] systemd[1]: Mounting /sysroot/nix/store...563gitlab # [ 3.667386] systemd[1]: Mounted /sysroot/nix/store.564gitlab # [ 3.669687] systemd[1]: Reached target Initrd File Systems.565gitlab # [ 3.672002] systemd[1]: Starting Find NixOS closure...566gitlab # [ 3.674300] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...567gitlab # [ 3.714807] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.568gitlab # [ 3.718553] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.569gitlab # [ 3.734816] systemd[1]: Finished Find NixOS closure.570gitlab # [ 3.737226] systemd[1]: Reached target Initrd Default Target.571gitlab # [ 3.739727] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...572gitlab # [ 3.790352] systemd[1]: Stopped target Initrd Default Target.573gitlab # [ 3.792947] systemd[1]: Stopped target Basic System.574gitlab # [ 3.795128] systemd[1]: Stopped target Initrd Root Device.575gitlab # [ 3.797608] systemd[1]: Stopped target Path Units.576gitlab # [ 3.799711] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.577gitlab # [ 3.803025] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.578gitlab # [ 3.806436] systemd[1]: Stopped target Slice Units.579gitlab # [ 3.808674] systemd[1]: Stopped target Socket Units.580gitlab # [ 3.810859] systemd[1]: Stopped target System Initialization.581gitlab # [ 3.813451] systemd[1]: Stopped target Swaps.582gitlab # [ 3.817311] systemd[1]: Stopped target Timer Units.583gitlab # [ 3.821778] systemd[1]: dbus.socket: Deactivated successfully.584gitlab # [ 3.825952] systemd[1]: Closed D-Bus System Message Bus Socket.585gitlab # [ 3.828515] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.586gitlab # [ 3.831297] systemd[1]: Stopped Find NixOS closure.587gitlab # [ 3.833375] systemd[1]: Starting Load Kernel Module 9pnet_virtio...588gitlab # [ 3.835991] systemd[1]: Starting rw-sysroot-nix-store.service...589gitlab # [ 3.838534] systemd[1]: systemd-sysctl.service: Deactivated successfully.590gitlab # [ 3.841347] systemd[1]: Stopped Apply Kernel Variables.591gitlab # [ 3.843405] systemd[1]: systemd-modules-load.service: Deactivated successfully.592gitlab # [ 3.846206] systemd[1]: Stopped Load Kernel Modules.593gitlab # [ 3.848391] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.594gitlab # [ 3.851271] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.595gitlab # [ 3.854200] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.596gitlab # [ 3.856799] systemd[1]: Stopped Create System Files and Directories.597gitlab # [ 3.858900] systemd[1]: Stopped target Local File Systems.598gitlab # [ 3.860769] systemd[1]: Stopped target Preparation for Local File Systems.599gitlab # [ 3.862870] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.600gitlab # [ 3.864995] systemd[1]: Stopped Coldplug All udev Devices.601gitlab # [ 3.866557] systemd[1]: Stopping Rule-based Manager for Device Events and Files...602gitlab # [ 3.868669] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.603gitlab # [ 3.870623] systemd[1]: Stopped Virtual Console Setup.604gitlab # [ 3.872032] systemd[1]: initrd-cleanup.service: Deactivated successfully.605gitlab # [ 3.873761] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.606gitlab # [ 3.875479] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.607gitlab # [ 3.877287] systemd[1]: Finished Load Kernel Module 9pnet_virtio.608gitlab # [ 3.878717] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.880401] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.881759] systemd[1]: systemd-udevd.service: Deactivated successfully.611gitlab # [ 3.883294] systemd[1]: Stopped Rule-based Manager for Device Events and Files.612gitlab # [ 3.885136] systemd[1]: systemd-udevd.service: Consumed 2.229s CPU time over 2.146s wall clock time, 31.5M memory peak.613gitlab # [ 3.887377] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.614gitlab # [ 3.888989] systemd[1]: Closed udev Control Socket.615gitlab # [ 3.890070] systemd[1]: Starting Cleanup udev Database...616gitlab # [ 3.891247] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.617gitlab # [ 3.893005] systemd[1]: Stopped Create Static Device Nodes in /dev.618gitlab # [ 3.894230] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.619gitlab # [ 3.895823] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.620gitlab # [ 3.898174] systemd[1]: kmod-static-nodes.service: Deactivated successfully.621gitlab # [ 3.899537] systemd[1]: Stopped Create List of Static Device Nodes.622gitlab # [ 3.954534] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.623gitlab # [ 3.957047] systemd[1]: Finished Cleanup udev Database.624gitlab # [ 3.958925] systemd[1]: Reached target Switch Root.625gitlab # [ 3.960619] systemd[1]: Starting NixOS Activation...626gitlab # [ 4.141747] initrd-nixos-activation-start[224]: booting system configuration /nix/store/1dmv272sfx4ax5sd3xhgs6zvfqsc10vm-nixos-system-gitlab-test627gitlab # [ 4.214307] initrd-nixos-activation-start[224]: running activation script...628gitlab # [ 4.534090] initrd-nixos-activation-start[247]: setting up /etc...629gitlab # [ 4.704663] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.630gitlab # [ 4.707977] systemd[1]: Finished NixOS Activation.631gitlab # [ 4.710274] systemd[1]: Starting Switch Root...632gitlab # [ 4.762494] systemd[1]: Switching root.633gitlab # [ 4.863723] systemd-journald[94]: Received SIGTERM from PID 1 (systemd).634gitlab # [ 5.468963] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)635gitlab # [ 5.469102] systemd[1]: Detected virtualization qemu.636gitlab # [ 5.469175] systemd[1]: Detected architecture arm64.637gitlab # [ 5.469341] systemd[1]: Detected first boot.638gitlab # [ 5.470677] systemd[1]: Initializing machine ID from random generator.639gitlab # [ 5.714141] systemd[1]: bpf-restrict-fs: LSM BPF program attached640gitlab # [ 5.845820] systemd[1]: Applying preset policy.641gitlab # [ 6.054016] systemd[1]: Populated /etc with preset unit settings.642gitlab # [ 6.203230] systemd[1]: initrd-switch-root.service: Deactivated successfully.643gitlab # [ 6.203483] systemd[1]: Stopped initrd-switch-root.service.644gitlab # [ 6.205167] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.645gitlab # [ 6.208403] systemd[1]: Created slice Slice /system/getty.646gitlab # [ 6.215245] systemd[1]: Created slice GitLab DevOps Platform Slice.647gitlab # [ 6.220695] systemd[1]: Created slice User and Session Slice.648gitlab # [ 6.221394] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.649gitlab # [ 6.222111] systemd[1]: Started Forward Password Requests to Wall Directory Watch.650gitlab # [ 6.223286] systemd[1]: Expecting device /dev/hvc0...651gitlab # [ 6.224388] systemd[1]: Expecting device /dev/ttyAMA0...652gitlab # [ 6.225504] systemd[1]: Reached target Local Encrypted Volumes.653gitlab # [ 6.226635] systemd[1]: Stopped target initrd-fs.target.654gitlab # [ 6.227721] systemd[1]: Stopped target initrd-root-fs.target.655gitlab # [ 6.228772] systemd[1]: Stopped target initrd-switch-root.target.656gitlab # [ 6.229849] systemd[1]: Reached target Virtual Machines and Containers.657gitlab # [ 6.230966] systemd[1]: Reached target Path Units.658gitlab # [ 6.232064] systemd[1]: Reached target Remote File Systems.659gitlab # [ 6.233115] systemd[1]: Reached target Slice Units.660gitlab # [ 6.234166] systemd[1]: Reached target Swaps.661gitlab # [ 6.238142] systemd[1]: Listening on Query the User Interactively for a Password.662gitlab # [ 6.242129] systemd[1]: Listening on Process Core Dump Socket.663gitlab # [ 6.245083] systemd[1]: Listening on Credential Encryption/Decryption.664gitlab # [ 6.248585] systemd[1]: Listening on Factory Reset Management.665gitlab # [ 6.249871] systemd[1]: Listening on Hostname Service Socket.666gitlab # [ 6.259569] systemd[1]: Starting Journal Log Access Socket...667gitlab # [ 6.261848] systemd[1]: Listening on Journal Audit Socket.668gitlab # [ 6.265979] systemd[1]: Listening on Console Output Muting Service Socket.669gitlab # [ 6.267376] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.670gitlab # [ 6.268337] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os671gitlab # [ 6.269159] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki672gitlab # [ 6.274107] systemd[1]: Listening on Disk Repartitioning Service Socket.673gitlab # [ 6.275225] systemd[1]: Listening on udev Control Socket.674gitlab # [ 6.276342] systemd[1]: Listening on udev Varlink Socket.675gitlab # [ 6.320205] systemd[1]: Mounting Huge Pages File System...676gitlab # [ 6.325898] systemd[1]: Mounting POSIX Message Queue File System...677gitlab # [ 6.331553] systemd[1]: Mounting Kernel Debug File System...678gitlab # [ 6.337321] systemd[1]: Mounting Kernel Trace File System...679gitlab # [ 6.348526] systemd[1]: Starting Create List of Static Device Nodes...680gitlab # [ 6.355147] systemd[1]: Starting Load Kernel Module 9pnet_virtio...681gitlab # [ 6.357661] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs682gitlab # [ 6.376842] systemd[1]: Mounting Kernel Configuration File System...683gitlab # [ 6.378061] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm684gitlab # [ 6.379170] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore685gitlab # [ 6.396734] systemd[1]: Starting Load Kernel Module fuse...686gitlab # [ 6.397475] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67687gitlab # [ 6.406655] systemd[1]: Starting Journal Service...688gitlab # [ 6.412147] systemd[1]: Starting Load Kernel Modules...689gitlab # [ 6.423887] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...690gitlab # [ 6.429759] systemd[1]: Starting Remount Root and Kernel File Systems...691gitlab # [ 6.435783] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os692gitlab # [ 6.448179] systemd[1]: Starting Coldplug All udev Devices...693gitlab # [ 6.458474] systemd-journald[318]: Collecting audit messages is enabled.694gitlab # [ 6.459076] fuse: init (API version 7.45)695gitlab # [ 6.460308] systemd[1]: Listening on Journal Log Access Socket.696gitlab # [ 6.460917] systemd[1]: Mounted Huge Pages File System.697gitlab # [ 6.461430] systemd[1]: Mounted POSIX Message Queue File System.698gitlab # [ 6.461919] systemd[1]: Mounted Kernel Debug File System.699gitlab # [ 6.462389] systemd[1]: Mounted Kernel Trace File System.700gitlab # [ 6.468463] systemd[1]: Finished Create List of Static Device Nodes.701gitlab # [ 6.469298] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.702gitlab # [ 6.469931] systemd[1]: Finished Load Kernel Module 9pnet_virtio.703gitlab # [ 6.470453] systemd[1]: Mounted Kernel Configuration File System.704gitlab # [ 6.471099] systemd[1]: modprobe@fuse.service: Deactivated successfully.705gitlab # [ 6.473670] systemd[1]: Finished Load Kernel Module fuse.706gitlab # [ 6.474809] systemd[1]: Finished Load Kernel Modules.707gitlab # [ 6.473184] systemd[1]: Queued start job for default target Multi-User System.708gitlab # [ 6.477601] systemd[1]: Unnecessary job was removed for /dev/vdb.[ 6.481655] systemd[1]: Mounting FUSE Control File System...709gitlab # [ 6.484745] EXT4-fs (vda): re-mounted 0148e889-8386-41a8-a21e-2bd4fbe517f2.710gitlab # 711gitlab # [ 6.484850] systemd[1]: systemd-journald.service: Deactivated successfully.712gitlab # [ 6.486803] systemd-modules-load[319]: Using 3 probe threads713gitlab # [ 6.491784] systemd[1]: Starting Firewall...714gitlab # [ 6.488340] systemd-modules-load[319]: Module 'atkbd' is built in715gitlab # [ 6.491429] systemd-modules-load[319]: Module 'loop' is built in716gitlab # [ 6.493161] systemd-modules-load[319]: Inserted module 'tls'717gitlab # [ 6.499804] systemd[1]: Starting Apply Kernel Variables...718gitlab # [ 6.501340] systemd-oomd[321]: No swap; memory pressure usage will be degraded719gitlab # [ 6.522783] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...720gitlab # [ 6.529048] systemd[1]: Started Journal Service.721gitlab # [ 6.532283] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.722gitlab # [ 6.533485] systemd[1]: Finished Remount Root and Kernel File Systems.723gitlab # [ 6.534634] systemd[1]: Mounted FUSE Control File System.724gitlab # [ 6.542330] systemd[1]: Finished Apply Kernel Variables.725gitlab # [ 6.548075] systemd[1]: Listening on Disk Image Download Service Socket.726gitlab # [ 6.552297] systemd[1]: Starting Flush Journal to Persistent Storage...727gitlab # [ 6.553582] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore728gitlab # [ 6.560174] systemd[1]: Starting Load/Save OS Random Seed...729gitlab # [ 6.561548] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os730gitlab # [ 6.579721] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.731gitlab # [ 6.584215] systemd[1]: Starting Create Static Device Nodes in /dev...732gitlab # [ 6.598317] systemd-journald[318]: Received client request to flush runtime journal.733gitlab # [ 6.639064] systemd[1]: Finished Create Static Device Nodes in /dev.734gitlab # [ 6.643107] systemd[1]: Finished Load/Save OS Random Seed.735gitlab # [ 6.644381] systemd[1]: Reached target First Boot Complete.736gitlab # [ 6.645445] systemd[1]: Reached target Preparation for Local File Systems.737gitlab # [ 6.646688] systemd[1]: Starting Rule-based Manager for Device Events and Files...738gitlab # [ 6.648183] systemd[1]: Finished Flush Journal to Persistent Storage.739gitlab # [ 6.669689] systemd-udevd[365]: Using default interface naming scheme 'v261'.740gitlab # [ 6.711034] systemd[1]: Started Rule-based Manager for Device Events and Files.741gitlab # [ 7.010624] systemd[1]: Finished Firewall.742gitlab # [ 7.121134] systemd[1]: Finished Coldplug All udev Devices.743gitlab # [ 7.202736] systemd[1]: Mounting /run/wrappers...744gitlab # [ 7.207330] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs745gitlab # [ 7.258330] systemd[1]: Mounted /run/wrappers.746gitlab # [ 7.260545] systemd[1]: Reached target Local File Systems.747gitlab # [ 7.264373] systemd[1]: Listening on Boot Loader Control Service Socket.748gitlab # [ 7.268095] systemd[1]: Starting register-nix-paths.service...749gitlab # [ 7.273221] systemd[1]: Starting Create SUID/SGID Wrappers...750gitlab # [ 7.275934] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.751gitlab # [ 7.298631] systemd[1]: Starting Save Transient machine-id to Disk...752gitlab # [ 7.306779] systemd[1]: Starting Create System Files and Directories...753gitlab # [ 7.312204] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.754gitlab # [ 7.313882] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.755gitlab # [ 7.330161] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.756gitlab # [ 7.337314] systemd[1]: Finished Save Transient machine-id to Disk.757gitlab # [ 7.352559] systemd[1]: Finished Create System Files and Directories.758gitlab # [ 7.380562] (udev-worker)[415]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.759gitlab # [ 7.383311] (udev-worker)[415]: Network interface NamePolicy= disabled on kernel command line.760gitlab # [ 7.393988] systemd[1]: Starting Rebuild Journal Catalog...761gitlab # [ 7.395930] systemd[1]: Starting Record System Boot/Shutdown in UTMP...762gitlab # [ 7.407331] systemd[1]: Condition check resulted in Virtio network device being skipped.763gitlab # [ 7.409697] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore764gitlab # [ 7.411278] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.765gitlab # [ 7.412620] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67766gitlab # [ 7.415003] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore767gitlab # [ 7.417028] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os768gitlab # [ 7.418355] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os769gitlab # [ 7.419895] (udev-worker)[406]: Network interface NamePolicy= disabled on kernel command line.770gitlab # [ 7.449806] systemd[1]: Finished Record System Boot/Shutdown in UTMP.771gitlab # [ 7.467040] systemd[1]: Finished Rebuild Journal Catalog.772gitlab # [ 7.473904] systemd[1]: Starting Update is Completed...773gitlab # [ 7.501504] systemd[1]: Finished Update is Completed.774gitlab # [ 7.513916] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.775gitlab # [ 7.515222] systemd[1]: Finished Create SUID/SGID Wrappers.776gitlab # [ 7.516152] systemd[1]: suid-sgid-wrappers.service: Consumed 153ms CPU time over 241ms wall clock time, 6.1M memory peak, 1.9M read from disk.777gitlab # [ 7.523301] mousedev: PS/2 mouse device common for all mice778gitlab # [ 7.775491] systemd[1]: Finished register-nix-paths.service.779gitlab # [ 7.777038] systemd[1]: Reached target System Initialization.780gitlab # [ 7.778473] systemd[1]: Started Discard unused filesystem blocks once a week.781gitlab # [ 7.780431] systemd[1]: Started logrotate.timer.782gitlab # [ 7.781191] systemd[1]: Started Daily Cleanup of Temporary Directories.783gitlab # [ 7.782137] systemd[1]: Reached target Timer Units.784gitlab # [ 7.782866] systemd[1]: Listening on D-Bus System Message Bus Socket.785gitlab # [ 7.783791] systemd[1]: Listening on Nix Daemon Socket.786gitlab # [ 7.805778] systemd[1]: Starting nixbot CI service socket...787gitlab # [ 7.806711] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.788gitlab # [ 7.807971] systemd[1]: Listening on nixbot CI service socket.789gitlab # [ 7.809160] systemd[1]: Reached target Socket Units.790gitlab # [ 7.810460] systemd[1]: Starting D-Bus System Message Bus...791gitlab # [ 7.845104] dbus-broker-launch[563]: Looking up NSS user entry for 'systemd-timesync'...792gitlab # [ 7.846781] dbus-broker-launch[563]: NSS returned no entry for 'systemd-timesync'793gitlab # [ 7.848961] dbus-broker-launch[563]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"794gitlab # [ 7.851796] systemd[1]: Started D-Bus System Message Bus.795gitlab # [ 7.864343] dbus-broker-launch[563]: Ready796gitlab # [ 7.865044] systemd[1]: Reached target Basic System.797gitlab # [ 7.870259] systemd[1]: Started backdoor.service.798gitlab # [ 7.895798] systemd[1]: Starting gitlab-config.service...799gitlab # [ 7.896733] systemd[1]: Starting Import lastlog data into lastlog2 database...800gitlab # [ 7.897721] systemd[1]: Starting Logrotate configuration check...801gitlab # connecting to host...802gitlab # [ 7.912678] systemd[1]: Starting Name Service Cache Daemon (nsncd)...803gitlab # [ 7.919262] systemd[1]: Starting Post-Boot Actions...804gitlab: Guest shell says: b'Spawning backdoor root shell...\n'805gitlab # [ 7.925729] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3806gitlab # [ 7.926651] logrotate[572]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.807gitlab # [ 7.931991] logrotate[572]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf808gitlab: connected to guest root shell809gitlab # [ 7.933407] logrotate[572]: note: 'monthly' overrides previously specified 'weekly'810gitlab: (connecting took 8.39 seconds)811gitlab # [ 7.934366] logrotate[572]: Reading state from file: /var/lib/logrotate.status812gitlab: (finished: waiting for the VM to finish booting, in 8.39 seconds)813gitlab # [ 7.935271] logrotate[572]: state file /var/lib/logrotate.status does not exist814gitlab # [ 7.936434] logrotate[572]: Allocating hash table for state file, size 64 entries815gitlab # [ 7.940124] logrotate[572]: Handling 4 logs816gitlab # [ 7.940730] logrotate[572]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed817gitlab # [ 7.942939] logrotate[572]: considering log /var/log/btmp818gitlab # [ 7.944707] logrotate[572]: Creating new state819gitlab # [ 7.945448] logrotate[572]: Now: 2026-09-09 10:31820gitlab # [ 7.946147] logrotate[572]: Last rotated at 2026-09-09 10:00821gitlab # [ 7.947100] logrotate[572]: log does not need rotating (log has already been rotated)822gitlab # [ 7.952208] logrotate[572]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed823gitlab # [ 7.954332] logrotate[572]: considering log /var/log/wtmp824gitlab # [ 7.955052] logrotate[572]: Creating new state825gitlab # [ 7.955663] logrotate[572]: Now: 2026-09-09 10:31826gitlab # [ 7.965270] logrotate[572]: Last rotated at 2026-09-09 10:00827gitlab # [ 7.966354] logrotate[572]: log does not need rotating (log has already been rotated)828gitlab # [ 7.967974] logrotate[572]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed829gitlab # [ 7.976209] logrotate[572]: switching euid from 0 to 165 and egid from 0 to 165 (pid 572)830gitlab # [ 7.978175] logrotate[572]: considering log /var/gitlab/state/log/*.log831gitlab # [ 7.979087] logrotate[572]: log /var/gitlab/state/log/*.log does not exist -- skipping832gitlab # [ 7.980330] logrotate[572]: Creating new state833gitlab # [ 7.980929] logrotate[572]: switching euid from 165 to 0 and egid from 165 to 0 (pid 572)834gitlab # [ 7.982242] logrotate[572]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed835gitlab # [ 7.984377] logrotate[572]: switching euid from 0 to 60 and egid from 0 to 60 (pid 572)836gitlab # [ 7.987561] logrotate[572]: considering log /var/log/nginx/*.log837gitlab # [ 7.988482] logrotate[572]: log /var/log/nginx/*.log does not exist -- skipping838gitlab # [ 7.989509] logrotate[572]: Creating new state839gitlab # [ 7.990145] logrotate[572]: not running postrotate script, since no logs were rotated840gitlab # [ 7.991190] logrotate[572]: switching euid from 60 to 0 and egid from 60 to 0 (pid 572)841gitlab # [ 7.993147] systemd[1]: Started Reset console on configuration changes.842gitlab # [ 7.994401] systemd[1]: Starting resolvconf update...843gitlab # [ 7.995599] nsncd[573]: Sep 09 10:31:11.784 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"844gitlab # [ 7.998658] systemd[1]: Started Name Service Cache Daemon (nsncd).845gitlab # [ 7.999759] systemd[1]: Finished Logrotate configuration check.846gitlab # [ 8.001633] systemd[1]: Finished Post-Boot Actions.847gitlab # [ 8.002523] systemd[1]: Reached target Host and Network Name Lookups.848gitlab # [ 8.003548] systemd[1]: Reached target User and Group Name Lookups.849gitlab # [ 8.006316] systemd[1]: Starting User Login Management...850gitlab # [ 8.007374] systemd[1]: Finished Import lastlog data into lastlog2 database.851gitlab # [ 8.049975] systemd[1]: Stopped target Host and Network Name Lookups.852gitlab # [ 8.050945] systemd[1]: Stopping Host and Network Name Lookups...853gitlab # [ 8.053347] systemd[1]: Stopped target User and Group Name Lookups.854gitlab # [ 8.054259] systemd[1]: Stopping User and Group Name Lookups...855gitlab # [ 8.055155] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...856gitlab # [ 8.067338] systemd-logind[615]: New seat seat0.857gitlab # [ 8.123537] systemd[1]: nscd.service: Deactivated successfully.858gitlab # [ 8.124890] systemd[1]: Stopped Name Service Cache Daemon (nsncd).859gitlab # [ 8.125939] systemd[1]: nscd.service: Consumed 20ms CPU time over 156ms wall clock time, 7.1M memory peak, 5.8M read from disk.860gitlab # [ 8.127870] nsncd[670]: Sep 09 10:31:11.940 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"861gitlab # [ 8.130162] systemd[1]: Starting Name Service Cache Daemon (nsncd)...862gitlab # [ 8.131100] systemd[1]: Finished resolvconf update.863gitlab # [ 8.131859] systemd[1]: Started Name Service Cache Daemon (nsncd).864gitlab # [ 8.133177] systemd-logind[615]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)865gitlab # [ 8.134465] systemd-logind[615]: Watching system buttons on /dev/input/event0 (gpio-keys)866gitlab # [ 8.136472] systemd[1]: Started User Login Management.867gitlab # [ 8.137246] systemd[1]: Reached target Preparation for Network.868gitlab # [ 8.138125] systemd[1]: Reached target Host and Network Name Lookups.869gitlab # [ 8.139012] systemd[1]: Reached target User and Group Name Lookups.870gitlab # [ 8.139929] systemd[1]: Starting DHCP Client...871gitlab # [ 8.143614] systemd[1]: Starting linger-users.service...872gitlab # [ 8.146147] systemd[1]: Starting Address configuration of eth1...873gitlab # [ 8.162975] systemd-logind[615]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)874gitlab # [ 8.165018] systemd[1]: Starting Extra networking commands....875gitlab # [ 8.170001] systemd[1]: Starting Virtual Console Setup...876gitlab # [ 8.179645] systemd[1]: linger-users.service: Deactivated successfully.877gitlab # [ 8.184379] systemd[1]: Finished linger-users.service.878gitlab # [ 8.196577] network-addresses-eth1-start[689]: adding address 192.168.1.1/24... done879gitlab # [ 8.206206] network-addresses-eth1-start[689]: adding address 2001:db8:1::1/64... done880gitlab # [ 8.220523] systemd[1]: Finished Address configuration of eth1.881gitlab # [ 8.240329] systemd-vconsole-setup[692]: Configuration of first virtual console was skipped, ignoring remaining ones.882gitlab # [ 8.242792] systemd[1]: Finished Virtual Console Setup.883gitlab # [ 8.264763] systemd[1]: Finished Extra networking commands..884gitlab # [ 8.265797] systemd[1]: Reached target Network.885gitlab # [ 8.267957] systemd[1]: Starting gitlab-workhorse.service...886gitlab # [ 8.270890] systemd[1]: Starting Nginx Web Server...887gitlab # [ 8.277715] systemd[1]: Starting PostgreSQL Server...888gitlab # [ 8.280245] dhcpcd[713]: dhcpcd-10.3.2 starting889gitlab # [ 8.282408] systemd[1]: Starting Redis Server - redis-gitlab...890gitlab # [ 8.284597] dhcpcd[763]: dev: loaded udev891gitlab # [ 8.287370] systemd[1]: Starting Permit User Sessions...892gitlab # [ 8.300220] 8021q: 802.1Q VLAN Support v1.8893gitlab # [ 8.300625] 8021q: adding VLAN 0 to HW filter on device eth1894gitlab # [ 8.307142] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.895gitlab # [ 8.324080] systemd[1]: Finished Permit User Sessions.896gitlab # [ 8.337642] systemd[1]: Started Getty on tty1.897gitlab # [ 8.340299] systemd[1]: Reached target Login Prompts.898gitlab # [ 8.353772] cfg80211: Loading compiled-in X.509 certificates for regulatory database899gitlab # [ 8.361131] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'900gitlab # [ 8.361717] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'901gitlab # [ 8.363492] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2902gitlab # [ 8.363822] cfg80211: failed to load regulatory.db903gitlab # [ 8.404093] 8021q: adding VLAN 0 to HW filter on device eth0904gitlab # [ 8.402808] dhcpcd[763]: eth0: waiting for carrier905gitlab # [ 8.405090] dhcpcd[763]: eth0: carrier acquired906gitlab # [ 8.415148] dhcpcd[763]: DUID 00:01:00:01:32:33:f1:f0:52:54:00:12:34:56907gitlab # [ 8.416567] dhcpcd[763]: eth0: IAID 00:12:34:56908gitlab # [ 8.417413] dhcpcd[763]: eth0: adding address fe80::5054:ff:fe12:3456909gitlab # [ 8.459897] nginx-pre-start[790]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok910gitlab # [ 8.461894] nginx-pre-start[790]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful911gitlab # [ 8.466627] systemd[1]: Started Nginx Web Server.912gitlab # [ 8.483561] redis-server[787]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.913gitlab # [ 8.486610] redis-server[787]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo914gitlab # [ 8.488678] postgresql-pre-start[793]: The files belonging to this database system will be owned by user "postgres".915gitlab # [ 8.490378] postgresql-pre-start[793]: This user must also own the server process.916gitlab # [ 8.491586] postgresql-pre-start[793]: The database cluster will be initialized with locale "en_US.UTF-8".917gitlab # [ 8.492999] postgresql-pre-start[793]: The default database encoding has accordingly been set to "UTF8".918gitlab # [ 8.494278] postgresql-pre-start[793]: The default text search configuration will be set to "english".919gitlab # [ 8.495490] postgresql-pre-start[793]: Data page checksums are enabled.920gitlab # [ 8.496501] postgresql-pre-start[793]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok921gitlab # [ 8.498866] systemd[1]: Started Redis Server - redis-gitlab.922gitlab # [ 8.499726] redis-server[787]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=787, just started923gitlab # [ 8.501719] postgresql-pre-start[793]: creating subdirectories ... ok924gitlab # [ 8.502746] postgresql-pre-start[793]: selecting dynamic shared memory implementation ... posix925gitlab # [ 8.504213] redis-server[787]: Configuration loaded926gitlab # [ 8.505119] redis[787]: monotonic clock: ARM CNTVCT @ 1000 ticks/us927gitlab # [ 8.506102] redis[787]: Running mode=standalone, port=0.928gitlab # [ 8.506976] redis[787]: Server initialized929gitlab # [ 8.507709] redis[787]: Ready to accept connections unix930gitlab # [ 8.508650] redis[787]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.931gitlab # [ 8.540140] postgresql-pre-start[793]: selecting default "max_connections" ... 100932gitlab # [ 8.598972] postgresql-pre-start[793]: selecting default "shared_buffers" ... 128MB933gitlab # [ 8.881268] systemd[1]: Started gitlab-workhorse.service.934gitlab # [ 9.113621] postgresql-pre-start[793]: selecting default time zone ... UTC935gitlab # [ 9.117361] postgresql-pre-start[793]: creating configuration files ... ok936gitlab # [ 9.290429] gitlab-workhorse[820]: time="2026-09-09T10:31:13Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4937gitlab # [ 9.296570] gitlab-workhorse[820]: time="2026-09-09T10:31:13Z" level=info msg="Using redis/go-redis"938gitlab # [ 9.305020] gitlab-workhorse[820]: time="2026-09-09T10:31:13Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix939gitlab # [ 9.352693] postgresql-pre-start[793]: running bootstrap script ... ok940gitlab # [ 10.084782] postgresql-pre-start[793]: performing post-bootstrap initialization ... ok941gitlab # [ 10.310177] dhcpcd[763]: eth0: soliciting an IPv6 router942gitlab # [ 10.314382] dhcpcd[763]: eth0: Router Advertisement from fe80::2943gitlab # [ 10.317411] dhcpcd[763]: eth0: adding address fec0::5054:ff:fe12:3456/64944gitlab # [ 10.320839] dhcpcd[763]: eth0: adding route to fec0::/64945gitlab # [ 10.323463] dhcpcd[763]: eth0: adding default route via fe80::2946gitlab # [ 10.351593] postgresql-pre-start[793]: syncing data to disk ... ok947gitlab # [ 10.354219] postgresql-pre-start[793]: initdb: warning: enabling "trust" authentication for local connections948gitlab # [ 10.358096] postgresql-pre-start[793]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.949gitlab # [ 10.364576] postgresql-pre-start[793]: Success. You can now start the database server using:950gitlab # [ 10.367893] postgresql-pre-start[793]: pg_ctl -D /var/lib/postgresql/18 -l logfile start951gitlab # [ 10.379149] dhcpcd[763]: eth0: soliciting a DHCP lease952gitlab # [ 10.388778] dhcpcd[763]: eth0: offered 10.0.2.15 from 10.0.2.2953gitlab # [ 10.405017] dhcpcd[763]: eth0: probing address 10.0.2.15/24954gitlab # [ 10.544146] postgres[854]: [854] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit955gitlab # [ 10.549699] postgres[854]: [854] LOG: listening on IPv6 address "::1", port 5432956gitlab # [ 10.553415] postgres[854]: [854] LOG: listening on IPv4 address "127.0.0.1", port 5432957gitlab # [ 10.558338] postgres[854]: [854] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"958gitlab # [ 10.565222] postgres[863]: [863] LOG: database system was shut down at 2026-09-09 10:31:13 GMT959gitlab # [ 10.570554] postgres[854]: [854] LOG: database system is ready to accept connections960gitlab # [ 10.575257] systemd[1]: Started PostgreSQL Server.961gitlab # [ 10.581653] systemd[1]: Starting PostgreSQL Setup Scripts...962gitlab # [ 10.822976] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[872]: mkdir -p /var/gitlab/state/home/.ssh: OK963gitlab # [ 10.827140] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[872]: chmod 700 /var/gitlab/state/home/.ssh: OK964gitlab # [ 10.833195] postgresql-setup-start[879]: CREATE DATABASE965gitlab # [ 10.867802] postgresql-setup-start[893]: CREATE ROLE966gitlab # [ 10.881923] postgresql-setup-start[897]: ALTER DATABASE967gitlab # [ 10.897285] systemd[1]: Finished gitlab-config.service.968gitlab # [ 10.900590] systemd[1]: Started gitaly.service.969gitlab # [ 10.924618] postgresql-setup-start[904]: CREATE ROLE970gitlab # [ 10.929096] systemd[1]: Finished PostgreSQL Setup Scripts.971gitlab # [ 10.930807] systemd[1]: Reached target PostgreSQL.972gitlab # [ 10.933779] systemd[1]: Starting gitlab-db-config.service...973gitlab # [ 10.937239] systemd[1]: Starting gitlab-postgresql.service...974gitlab # [ 11.103650] gitlab-postgresql-start[915]: CREATE DATABASE975gitlab # [ 11.160472] gitlab-postgresql-start[926]: CREATE EXTENSION976gitlab # [ 11.252682] gitlab-postgresql-start[928]: CREATE EXTENSION977gitlab # [ 11.259704] systemd[1]: Finished gitlab-postgresql.service.978gitlab # [ 11.472242] gitaly[903]: time="2026-09-09T10:31:15.290Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=903979gitlab # [ 11.484152] gitaly[903]: time="2026-09-09T10:31:15.291Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=903980gitlab # [ 11.486012] gitaly[903]: time="2026-09-09T10:31:15.291Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=903981gitlab # [ 11.488150] gitaly[903]: time="2026-09-09T10:31:15.291Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=903982gitlab # [ 11.489875] gitaly[903]: time="2026-09-09T10:31:15.291Z" level=info msg="Starting Gitaly" pid=903 version=983gitlab # [ 11.679312] gitaly[903]: time="2026-09-09T10:31:15.498Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=207 pid=903984gitlab # [ 11.681457] gitaly[903]: time="2026-09-09T10:31:15.498Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=903985gitlab # [ 11.683212] gitaly[903]: time="2026-09-09T10:31:15.499Z" level=info msg="finished initializing command factory" duration_ms=0 pid=903986gitlab # [ 11.685177] gitaly[903]: time="2026-09-09T10:31:15.499Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-903/git-exec-349069231.d/git pid=903987gitlab # [ 11.692105] gitaly[903]: time="2026-09-09T10:31:15.511Z" level=info msg="finished detecting git version" duration_ms=12 pid=903988gitlab # [ 11.693965] gitaly[903]: time="2026-09-09T10:31:15.511Z" level=info msg="using Git version" pid=903 version=2.53.g989gitlab # [ 11.695580] gitaly[903]: time="2026-09-09T10:31:15.511Z" level=info msg="clearing disk cache object folder" pid=903 storage=default990gitlab # [ 11.697502] gitaly[903]: time="2026-09-09T10:31:15.511Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1915294232 pid=903 storage=default991gitlab # [ 11.700204] gitaly[903]: time="2026-09-09T10:31:15.511Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1915294232 pid=903 storage=default992gitlab # [ 11.703160] gitaly[903]: time="2026-09-09T10:31:15.511Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=903993gitlab # [ 11.706634] gitaly[903]: time="2026-09-09T10:31:15.512Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=903994gitlab # [ 11.709937] gitaly[903]: time="2026-09-09T10:31:15.512Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1915294232 clear_duration_ms=0 pid=903 storage=default995gitlab # [ 11.714399] gitaly[903]: time="2026-09-09T10:31:15.533Z" level=info msg="counting repositories" pid=903996gitlab # [ 11.715844] gitaly[903]: time="2026-09-09T10:31:15.533Z" level=info msg="starting to count repositories" pid=903 storage_path=/var/gitlab/state/repositories997gitlab # [ 11.717954] gitaly[903]: time="2026-09-09T10:31:15.533Z" level=info msg="finished tempdir cleaner walk" pid=903 storage=default time_ms=0998gitlab # [ 11.719654] gitaly[903]: time="2026-09-09T10:31:15.533Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=903 storage_path=/var/gitlab/state/repositories999gitlab # [ 11.722120] gitaly[903]: time="2026-09-09T10:31:15.533Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9031000gitlab # [ 11.723876] gitaly[903]: time="2026-09-09T10:31:15.533Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9031001gitlab # [ 11.726212] gitaly[903]: time="2026-09-09T10:31:15.533Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=903 schema=unix1002gitlab # [ 11.728245] gitaly[903]: time="2026-09-09T10:31:15.534Z" level=info msg="listening at address" address=/run/gitaly/gitaly-903/sock.d/intern pid=903 schema=unix1003gitlab # [ 11.730109] gitaly[903]: time="2026-09-09T10:31:15.535Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9031004gitlab # [ 11.731739] gitaly[903]: time="2026-09-09T10:31:15.535Z" level=info msg="Started Gitaly" duration_ms=244 pid=9031005gitlab # [ 11.733187] gitaly[903]: time="2026-09-09T10:31:15.535Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9031006gitlab # [ 11.734791] gitaly[903]: time="2026-09-09T10:31:15.535Z" level=info msg="maintenance: daily scheduled" pid=903 scheduled="2026-09-09 12:00:00 +0000 UTC"1007gitlab # [ 12.218441] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1008gitlab # [ 12.227428] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1009gitlab # [ 12.239114] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1010gitlab # [ 15.045120] gitaly[903]: time="2026-09-09T10:31:18.863Z" level=info msg="License database preloaded" duration_ms=3548 pid=9031011gitlab # [ 15.067252] dhcpcd[763]: eth0: leased 10.0.2.15 for 86400 seconds1012gitlab # [ 15.069982] dhcpcd[763]: eth0: adding route to 10.0.2.0/241013gitlab # [ 15.072318] dhcpcd[763]: eth0: adding default route via 10.0.2.21014gitlab # [ 15.234694] systemd[1]: Started DHCP Client.1015gitlab # [ 15.237624] systemd[1]: Reached target Network is Online.1016gitlab # [ 57.877293] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[910]: W, [2026-09-09T10:32:01.693839 #910] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1017gitlab # [ 59.357198] gitlab-workhorse[820]: time="2026-09-09T10:32:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1018gitlab # [ 61.231895] postgres[1438]: [1438] ERROR: relation "feature_gates" does not exist at character 5231019gitlab # [ 61.233432] postgres[1438]: [1438] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1020gitlab # [ 61.234689] postgres[1438]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1021gitlab # [ 61.236276] postgres[1438]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1022gitlab # [ 61.237523] postgres[1438]: attidentity AS identity,1023gitlab # [ 61.238500] postgres[1438]: attgenerated as attgenerated1024gitlab # [ 61.239368] postgres[1438]: FROM pg_attribute a1025gitlab # [ 61.240100] postgres[1438]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1026gitlab # [ 61.241355] postgres[1438]: LEFT JOIN pg_type t ON a.atttypid = t.oid1027gitlab # [ 61.242280] postgres[1438]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1028gitlab # [ 61.243699] postgres[1438]: WHERE a.attrelid = '"feature_gates"'::regclass1029gitlab # [ 61.244696] postgres[1438]: AND a.attnum > 0 AND NOT a.attisdropped1030gitlab # [ 61.245606] postgres[1438]: ORDER BY a.attnum1031gitlab # [ 61.246260] postgres[1438]:1032gitlab # [ 66.335394] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1489]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1033gitlab # [ 66.335841] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1489]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1034gitlab # [ 69.366814] gitlab-workhorse[820]: time="2026-09-09T10:32:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1035gitlab # [ 79.367957] gitlab-workhorse[820]: time="2026-09-09T10:32:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1036gitlab # [ 89.374696] gitlab-workhorse[820]: time="2026-09-09T10:32:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1037gitlab # [ 92.298141] postgres[1592]: [1592] ERROR: relation "table_without_models" does not exist1038gitlab # [ 92.302324] postgres[1592]: [1592] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1039gitlab # [ 99.382435] gitlab-workhorse[820]: time="2026-09-09T10:32:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 109.392442] gitlab-workhorse[820]: time="2026-09-09T10:32:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1041gitlab # [ 119.402771] gitlab-workhorse[820]: time="2026-09-09T10:33:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 122.015454] systemd[1]: Finished gitlab-db-config.service.1043gitlab # [ 122.021333] systemd[1]: Started gitlab-sidekiq.service.1044gitlab # [ 122.026702] systemd[1]: Starting gitlab.service...1045gitlab # [ 122.598494] bundle[1967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1046gitlab # [ 122.604828] bundle[1967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1047gitlab # [ 122.610674] bundle[1967]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1048gitlab # [ 127.377454] sidekiq-cluster[1966]: {"severity":"INFO","time":"2026-09-09T10:33:11.167Z","message":"Starting cluster with 1 processes"}1049gitlab # [ 127.502500] bundle[1967]: {"timestamp":"2026-09-09T10:33:11.289Z","pid":1967,"message":"* Enabling systemd notification integration"}1050gitlab # [ 127.507862] bundle[1967]: {"timestamp":"2026-09-09T10:33:11.320Z","pid":1967,"message":"Puma starting in cluster mode..."}1051gitlab # [ 127.512721] bundle[1967]: {"timestamp":"2026-09-09T10:33:11.321Z","pid":1967,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1052gitlab # [ 127.518079] bundle[1967]: {"timestamp":"2026-09-09T10:33:11.321Z","pid":1967,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1053gitlab # [ 127.524332] bundle[1967]: {"timestamp":"2026-09-09T10:33:11.321Z","pid":1967,"message":"* Min threads: 0"}1054gitlab # [ 127.528470] bundle[1967]: {"timestamp":"2026-09-09T10:33:11.321Z","pid":1967,"message":"* Max threads: 4"}1055gitlab # [ 127.532623] bundle[1967]: {"timestamp":"2026-09-09T10:33:11.321Z","pid":1967,"message":"* Environment: production"}1056gitlab # [ 127.536826] bundle[1967]: {"timestamp":"2026-09-09T10:33:11.321Z","pid":1967,"message":"* Master PID: 1967"}1057gitlab # [ 127.540969] bundle[1967]: {"timestamp":"2026-09-09T10:33:11.321Z","pid":1967,"message":"* Workers: 2"}1058gitlab # [ 127.544870] bundle[1967]: {"timestamp":"2026-09-09T10:33:11.321Z","pid":1967,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1059gitlab # [ 127.550450] bundle[1967]: {"timestamp":"2026-09-09T10:33:11.321Z","pid":1967,"message":"* Preloading application"}1060gitlab # [ 129.418905] gitlab-workhorse[820]: time="2026-09-09T10:33:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1061gitlab # [ 139.420210] gitlab-workhorse[820]: time="2026-09-09T10:33:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1062gitlab # [ 149.421267] gitlab-workhorse[820]: time="2026-09-09T10:33:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1063gitlab # [ 159.422551] gitlab-workhorse[820]: time="2026-09-09T10:33:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 167.533966] bundle[1967]: W, [2026-09-09T10:33:51.352112 #1967] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1065gitlab # [ 169.437197] gitlab-workhorse[820]: time="2026-09-09T10:33:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 170.164602] sidekiq-cluster[2016]: 2026-09-09T10:33:53.982Z pid=2016 tid=wnc INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2016, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430415872}1067gitlab # [ 170.450094] sidekiq-cluster[2016]: W, [2026-09-09T10:33:54.269195 #2016] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1068gitlab # [ 170.517328] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:54.336Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1069gitlab # [ 174.169072] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:57.987Z","message":"GitLab reliable fetch activated!"}1070gitlab # [ 174.169452] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:57.987Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1071gitlab # [ 174.201398] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.020Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1072gitlab # [ 174.208415] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.022Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1073gitlab # [ 174.215334] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.025Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1074gitlab # [ 174.221970] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.028Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1075gitlab # [ 174.229326] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.031Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1076gitlab # [ 174.235988] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.034Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1077gitlab # [ 174.242193] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.036Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1078gitlab # [ 174.247201] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.038Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1079gitlab # [ 174.251945] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.040Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1080gitlab # [ 174.256609] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.042Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1081gitlab # [ 174.261357] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.045Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1082gitlab # [ 174.265602] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.051Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1083gitlab # [ 174.269266] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.056Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1084gitlab # [ 174.272962] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.060Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1085gitlab # [ 174.276383] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.064Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1086gitlab # [ 174.279692] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.069Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1087gitlab # [ 174.282911] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.076Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1088gitlab # [ 174.285908] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.081Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1089gitlab # [ 174.288982] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.087Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1090gitlab # [ 174.291774] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.092Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1091gitlab # [ 174.294993] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.097Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1092gitlab # [ 174.298197] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.101Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1093gitlab # [ 174.300855] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.105Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1094gitlab # [ 174.303458] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.108Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1095gitlab # [ 174.306223] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.112Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1096gitlab # [ 174.308643] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.117Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1097gitlab # [ 174.310900] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.121Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1098gitlab # [ 174.313275] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.125Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1099gitlab # [ 174.315516] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.129Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1100gitlab # [ 174.317986] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.133Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1101gitlab # [ 174.320133] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.136Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1102gitlab # [ 174.322501] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.139Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1103gitlab # [ 174.324613] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.143Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1104gitlab # [ 174.327376] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.146Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1105gitlab # [ 174.329923] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.149Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1106gitlab # [ 174.332216] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.151Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1107gitlab # [ 174.334344] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.153Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1108gitlab # [ 174.337035] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.156Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1109gitlab # [ 174.339075] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.158Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1110gitlab # [ 174.341174] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.160Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1111gitlab # [ 174.343418] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.162Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1112gitlab # [ 174.345634] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.164Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1113gitlab # [ 174.347748] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.166Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1114gitlab # [ 174.349864] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.168Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1115gitlab # [ 174.351954] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.171Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1116gitlab # [ 174.354308] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.173Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1117gitlab # [ 174.356408] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.175Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1118gitlab # [ 174.358710] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.178Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1119gitlab # [ 174.361232] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.180Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1120gitlab # [ 174.364697] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.182Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1121gitlab # [ 174.367358] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.184Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1122gitlab # [ 174.370087] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.187Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1123gitlab # [ 174.381493] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.200Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1124gitlab # [ 174.384522] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.203Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1125gitlab # [ 174.387116] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.206Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1126gitlab # [ 174.389803] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.208Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1127gitlab # [ 174.392356] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.210Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1128gitlab # [ 174.395020] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.213Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1129gitlab # [ 174.397710] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.215Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1130gitlab # [ 174.400378] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.217Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1131gitlab # [ 174.402730] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.219Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1132gitlab # [ 174.405129] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.221Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1133gitlab # [ 174.407536] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.223Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1134gitlab # [ 174.410150] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.226Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1135gitlab # [ 174.412648] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.228Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1136gitlab # [ 174.415021] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.231Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1137gitlab # [ 174.417354] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.233Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1138gitlab # [ 174.419660] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.234Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1139gitlab # [ 174.422214] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.236Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1140gitlab # [ 174.424561] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.238Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1141gitlab # [ 174.426801] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.239Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1142gitlab # [ 174.429042] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.241Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1143gitlab # [ 174.431226] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.243Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1144gitlab # [ 174.433669] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.244Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1145gitlab # [ 174.435962] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.246Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1146gitlab # [ 174.438452] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.248Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1147gitlab # [ 174.440590] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.250Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1148gitlab # [ 174.442933] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.252Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1149gitlab # [ 174.445096] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.253Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1150gitlab # [ 174.447138] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.255Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1151gitlab # [ 174.449524] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.257Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1152gitlab # [ 174.451891] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.258Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1153gitlab # [ 174.454319] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.261Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1154gitlab # [ 174.456519] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.263Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1155gitlab # [ 174.458812] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.265Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1156gitlab # [ 174.461087] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.267Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1157gitlab # [ 174.463391] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.269Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1158gitlab # [ 174.465719] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.271Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1159gitlab # [ 174.467970] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.273Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1160gitlab # [ 174.470370] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.274Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1161gitlab # [ 174.472654] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.276Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1162gitlab # [ 174.474844] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.278Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1163gitlab # [ 174.477160] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.280Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1164gitlab # [ 174.479537] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.282Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1165gitlab # [ 174.481644] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.284Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1166gitlab # [ 174.483948] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.286Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1167gitlab # [ 174.486385] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.288Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1168gitlab # [ 174.488643] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.290Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1169gitlab # [ 174.490795] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.303Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1170gitlab # [ 174.492993] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.305Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1171gitlab # [ 174.495065] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.307Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1172gitlab # [ 174.497327] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.310Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1173gitlab # [ 174.499303] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.313Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1174gitlab # [ 174.501586] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.316Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1175gitlab # [ 174.503890] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.318Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1176gitlab # [ 174.506377] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.320Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1177gitlab # [ 174.508480] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.322Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1178gitlab # [ 174.510713] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.325Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1179gitlab # [ 174.512966] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:33:58.327Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1180gitlab # [ 179.435406] gitlab-workhorse[820]: time="2026-09-09T10:34:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1181gitlab # [ 189.436685] gitlab-workhorse[820]: time="2026-09-09T10:34:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1182gitlab # [ 199.447217] gitlab-workhorse[820]: time="2026-09-09T10:34:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1183gitlab # [ 209.458104] gitlab-workhorse[820]: time="2026-09-09T10:34:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 214.729581] postgres[2754]: [2754] ERROR: relation "table_without_models" does not exist1185gitlab # [ 214.729980] postgres[2754]: [2754] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1186gitlab # [ 217.988584] postgres[2783]: [2783] ERROR: relation "table_without_models" does not exist1187gitlab # [ 217.992099] postgres[2783]: [2783] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1188gitlab # [ 219.466075] gitlab-workhorse[820]: time="2026-09-09T10:34:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1189gitlab # [ 219.657863] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:34:43.476Z","message":"Booted Rails 7.2.3.1 application in production environment"}1190gitlab # [ 219.660989] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:34:43.479Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1191gitlab # [ 219.663016] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:34:43.480Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1192gitlab # [ 219.664882] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:34:43.480Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1193gitlab # [ 219.670399] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:34:43.488Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1194gitlab # [ 222.333245] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:34:46.151Z","message":"Cleaning working queues"}1195gitlab # [ 222.335034] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:34:46.153Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a6d8cb9a7835c29ee3089093","created_at":"2026-09-09T10:33:05.240Z","trace_propagation_headers":{"sentry-trace":"a99bdee0c450443ca827a6293dffbc7d-4c91b75601604502","baggage":"sentry-trace_id=a99bdee0c450443ca827a6293dffbc7d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"4e44e55586f639f7445d529aee1a409c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-09T10:33:05.252Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a6d8cb9a7835c29ee3089093: start","job_status":"start","queue_duration_s":100.901176,"scheduling_latency_s":100.901282}1196gitlab # [ 222.726886] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:34:46.545Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a6d8cb9a7835c29ee3089093","created_at":"2026-09-09T10:33:05.240Z","trace_propagation_headers":{"sentry-trace":"a99bdee0c450443ca827a6293dffbc7d-4c91b75601604502","baggage":"sentry-trace_id=a99bdee0c450443ca827a6293dffbc7d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"4e44e55586f639f7445d529aee1a409c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-09T10:33:05.252Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a6d8cb9a7835c29ee3089093: done: 0.391748 sec","job_status":"done","queue_duration_s":100.901176,"scheduling_latency_s":100.901282,"redis_calls":29,"redis_duration_s":0.014152999999999999,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.008173,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003902,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002078,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.199728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19887790000000002,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.391748,"completed_at":"2026-09-09T10:34:46.544Z","load_balancing_strategy":"primary","db_duration_s":0.105212,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1197gitlab # [ 224.707737] bundle[1967]: {"timestamp":"2026-09-09T10:34:48.525Z","pid":1967,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1198gitlab # [ 224.708134] bundle[1967]: {"timestamp":"2026-09-09T10:34:48.526Z","pid":1967,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1199gitlab # [ 224.708281] bundle[1967]: {"timestamp":"2026-09-09T10:34:48.526Z","pid":1967,"message":"! #\u003cThread:0x0000f0e80ec7e060 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1200gitlab # [ 224.708458] bundle[1967]: {"timestamp":"2026-09-09T10:34:48.526Z","pid":1967,"message":"! #\u003cThread:0x0000f0e80e5af248 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1201gitlab # [ 224.708610] bundle[1967]: {"timestamp":"2026-09-09T10:34:48.526Z","pid":1967,"message":"Use Ctrl-C to stop"}1202gitlab # [ 224.708727] bundle[1967]: {"timestamp":"2026-09-09T10:34:48.526Z","pid":1967,"message":"Sending status to systemd every 1.0 sec"}1203gitlab # [ 225.414330] bundle[1967]: {"timestamp":"2026-09-09T10:34:49.233Z","pid":1967,"message":"- Worker 0 (PID: 2892) booted in 0.65s, phase: 0"}1204gitlab # [ 225.500723] bundle[1967]: {"timestamp":"2026-09-09T10:34:49.319Z","pid":1967,"message":"- Worker 1 (PID: 2896) booted in 0.7s, phase: 0"}1205gitlab # [ 225.506183] systemd[1]: Started gitlab.service.1206gitlab # [ 225.508205] systemd[1]: Reached target Common target for all GitLab services..1207gitlab # [ 225.514764] systemd[1]: Starting setup-gitlab.service...1208gitlab # [ 225.568139] setup-gitlab-start[2929]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1209gitlab # [ 229.249328] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:34:53 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 36301210gitlab # [ 229.253252] setup-gitlab-start[2929]: + TOKEN=nixbot-test-token-of-20-chars1211gitlab # [ 229.255209] setup-gitlab-start[2929]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1212gitlab # [ 229.274528] runuser[2955]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1213gitlab # [ 229.836386] setup-gitlab-start[2956]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1214gitlab # [ 229.836736] setup-gitlab-start[2956]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1215gitlab # [ 229.838192] setup-gitlab-start[2956]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1216gitlab # [ 230.660950] setup-gitlab-start[2956]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1217gitlab # [ 230.667781] setup-gitlab-start[2956]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1218gitlab # [ 230.674127] setup-gitlab-start[2956]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1219gitlab # [ 236.223477] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:00.040Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fdf9276970202906d53ef1b4","created_at":"2026-09-09T10:34:59.996Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02582f78682dc621203d0dfcf0e31a7e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:35:00.036Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fdf9276970202906d53ef1b4: start","job_status":"start","queue_duration_s":0.003954,"scheduling_latency_s":0.004038}1220gitlab # [ 236.387677] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:00.206Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1221gitlab # [ 236.444190] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:00.262Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fdf9276970202906d53ef1b4","created_at":"2026-09-09T10:34:59.996Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02582f78682dc621203d0dfcf0e31a7e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:35:00.036Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fdf9276970202906d53ef1b4: done: 0.221773 sec","job_status":"done","queue_duration_s":0.003954,"scheduling_latency_s":0.004038,"redis_calls":10,"redis_duration_s":0.050121,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.032135,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01463,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003356,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00256032,"duration_s":0.221773,"completed_at":"2026-09-09T10:35:00.262Z","load_balancing_strategy":"primary","db_duration_s":0.016226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1222gitlab # [ 236.533283] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:00.274Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"45661cc504c24af5e8461f30","created_at":"2026-09-09T10:35:00.071Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b739d7c49c36810cdfab39b87868f401","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.154Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-45661cc504c24af5e8461f30: start","job_status":"start","queue_duration_s":0.120093,"scheduling_latency_s":0.120149}1223gitlab # [ 237.894724] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:01.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"45661cc504c24af5e8461f30","created_at":"2026-09-09T10:35:00.071Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b739d7c49c36810cdfab39b87868f401","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.154Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-45661cc504c24af5e8461f30: done: 1.437047 sec","job_status":"done","queue_duration_s":0.120093,"scheduling_latency_s":0.120149,"redis_calls":565,"redis_duration_s":0.798521,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004923,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.779926,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.718093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069184,"duration_s":1.437047,"completed_at":"2026-09-09T10:35:01.711Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1224gitlab # [ 237.896233] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:01.714Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"417e30ff26bbf3217cf9b4bf","created_at":"2026-09-09T10:35:00.173Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f67ec7e4dab1b1a8d9b1eace666cd45","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.182Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-417e30ff26bbf3217cf9b4bf: start","job_status":"start","queue_duration_s":1.532546,"scheduling_latency_s":1.532597}1225gitlab # [ 238.015240] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:01.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"417e30ff26bbf3217cf9b4bf","created_at":"2026-09-09T10:35:00.173Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f67ec7e4dab1b1a8d9b1eace666cd45","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.182Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-417e30ff26bbf3217cf9b4bf: done: 0.1183 sec","job_status":"done","queue_duration_s":1.532546,"scheduling_latency_s":1.532597,"redis_calls":12,"redis_duration_s":0.004016,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001353,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001992,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000671,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.066,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.066,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00077256,"duration_s":0.1183,"completed_at":"2026-09-09T10:35:01.832Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.066421,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1226gitlab # [ 238.091766] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:01.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0555825714753e3cf00ece77","created_at":"2026-09-09T10:35:00.195Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"beaeef9502efc082188e75bdb4b7627f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.228Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0555825714753e3cf00ece77: start","job_status":"start","queue_duration_s":1.607829,"scheduling_latency_s":1.607883}1227gitlab # [ 238.105928] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:01.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0555825714753e3cf00ece77","created_at":"2026-09-09T10:35:00.195Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"beaeef9502efc082188e75bdb4b7627f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.228Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0555825714753e3cf00ece77: done: 0.072203 sec","job_status":"done","queue_duration_s":1.607829,"scheduling_latency_s":1.607883,"redis_calls":19,"redis_duration_s":0.0057339999999999995,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001455,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000447,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002941,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045488,"duration_s":0.072203,"completed_at":"2026-09-09T10:35:01.908Z","load_balancing_strategy":"primary","db_duration_s":0.003919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1228gitlab # [ 238.147936] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:01.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"589a08430d2c6426f5851f39","created_at":"2026-09-09T10:35:00.257Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5eb0e8e5ea242133bdaaea2544f68949","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.281Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-589a08430d2c6426f5851f39: start","job_status":"start","queue_duration_s":1.629169,"scheduling_latency_s":1.629196}1229gitlab # [ 238.219673] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.037Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"589a08430d2c6426f5851f39","created_at":"2026-09-09T10:35:00.257Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5eb0e8e5ea242133bdaaea2544f68949","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.281Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-589a08430d2c6426f5851f39: done: 0.127168 sec","job_status":"done","queue_duration_s":1.629169,"scheduling_latency_s":1.629196,"redis_calls":12,"redis_duration_s":0.003156,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000361,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001404,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001391,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00107316,"exclusive_lock_hold_duration_s":0.06977592,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.127168,"completed_at":"2026-09-09T10:35:02.037Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03731,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 238.297720] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.040Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"209a288378f1c4ff3c50313f","created_at":"2026-09-09T10:35:00.318Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d4da425da962256e11392d04097afba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.347Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-209a288378f1c4ff3c50313f: start","job_status":"start","queue_duration_s":1.693303,"scheduling_latency_s":1.693332}1231gitlab # [ 238.315090] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.061Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1232gitlab # [ 238.319162] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.073Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"209a288378f1c4ff3c50313f","created_at":"2026-09-09T10:35:00.318Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d4da425da962256e11392d04097afba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.347Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-209a288378f1c4ff3c50313f: done: 0.032353 sec","job_status":"done","queue_duration_s":1.693303,"scheduling_latency_s":1.693332,"redis_calls":10,"redis_duration_s":0.002862,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000593,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00059,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042798,"duration_s":0.032353,"completed_at":"2026-09-09T10:35:02.073Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000737,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 238.361808] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.075Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a30b1b04a6cfbf544c4cbd0d","created_at":"2026-09-09T10:35:00.394Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39d3b67d35a94ccc26730c0ce3db78ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.414Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a30b1b04a6cfbf544c4cbd0d: start","job_status":"start","queue_duration_s":1.660918,"scheduling_latency_s":1.660947}1234gitlab # [ 238.375961] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.091Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1235gitlab # [ 238.379188] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.101Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a30b1b04a6cfbf544c4cbd0d","created_at":"2026-09-09T10:35:00.394Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39d3b67d35a94ccc26730c0ce3db78ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.414Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a30b1b04a6cfbf544c4cbd0d: done: 0.025675 sec","job_status":"done","queue_duration_s":1.660918,"scheduling_latency_s":1.660947,"redis_calls":10,"redis_duration_s":0.00267,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000537,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001602,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000531,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038062,"duration_s":0.025675,"completed_at":"2026-09-09T10:35:02.101Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00082,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236gitlab # [ 238.421068] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"be1227e6f511da5c6c0812e2","created_at":"2026-09-09T10:35:00.457Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d856299bbab5d9ce6fd8b527769c712","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.476Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-be1227e6f511da5c6c0812e2: start","job_status":"start","queue_duration_s":1.62738,"scheduling_latency_s":1.627402}1237gitlab # [ 238.435540] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.118Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1238gitlab # [ 238.439000] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"be1227e6f511da5c6c0812e2","created_at":"2026-09-09T10:35:00.457Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d856299bbab5d9ce6fd8b527769c712","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.476Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-be1227e6f511da5c6c0812e2: done: 0.024723 sec","job_status":"done","queue_duration_s":1.62738,"scheduling_latency_s":1.627402,"redis_calls":10,"redis_duration_s":0.0025180000000000003,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000536,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001476,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000506,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036722,"duration_s":0.024723,"completed_at":"2026-09-09T10:35:02.128Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 238.481946] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.130Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bdd90c30e08411269bfcd5c5","created_at":"2026-09-09T10:35:00.514Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"289d6c6c69781d5c285d3253d7fad405","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.536Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bdd90c30e08411269bfcd5c5: start","job_status":"start","queue_duration_s":1.593852,"scheduling_latency_s":1.593869}1240gitlab # [ 238.496153] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.152Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bdd90c30e08411269bfcd5c5","created_at":"2026-09-09T10:35:00.514Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"289d6c6c69781d5c285d3253d7fad405","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.536Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bdd90c30e08411269bfcd5c5: done: 0.022571 sec","job_status":"done","queue_duration_s":1.593852,"scheduling_latency_s":1.593869,"redis_calls":10,"redis_duration_s":0.002529,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000573,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001453,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033316,"duration_s":0.022571,"completed_at":"2026-09-09T10:35:02.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 238.537962] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.154Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"8e192295dd645a37937236c6","created_at":"2026-09-09T10:35:00.601Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2425beab086bdb12a1fc14d4737c0e6c","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.620Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-8e192295dd645a37937236c6: start","job_status":"start","queue_duration_s":1.533369,"scheduling_latency_s":1.533384}1242gitlab # [ 238.550801] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.174Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"8e192295dd645a37937236c6","created_at":"2026-09-09T10:35:00.601Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2425beab086bdb12a1fc14d4737c0e6c","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.620Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-8e192295dd645a37937236c6: done: 0.020496 sec","job_status":"done","queue_duration_s":1.533369,"scheduling_latency_s":1.533384,"redis_calls":12,"redis_duration_s":0.002795,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000472,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000474,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001343,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000506,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003159,"duration_s":0.020496,"completed_at":"2026-09-09T10:35:02.174Z","load_balancing_strategy":"primary","db_duration_s":0.000577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243gitlab # [ 238.592499] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"795dee008a29d8bc3b7debd2","created_at":"2026-09-09T10:35:00.643Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdcfadd91227118b56e4b83c58ef964f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.665Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-795dee008a29d8bc3b7debd2: start","job_status":"start","queue_duration_s":1.511035,"scheduling_latency_s":1.511051}1244gitlab # [ 238.606629] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"795dee008a29d8bc3b7debd2","created_at":"2026-09-09T10:35:00.643Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdcfadd91227118b56e4b83c58ef964f","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.665Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-795dee008a29d8bc3b7debd2: done: 0.024566 sec","job_status":"done","queue_duration_s":1.511035,"scheduling_latency_s":1.511051,"redis_calls":12,"redis_duration_s":0.003076,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000538,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001374,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001164,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055868,"exclusive_lock_hold_duration_s":0.0040948,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.024566,"completed_at":"2026-09-09T10:35:02.200Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245gitlab # [ 238.649267] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"17370ed6cf2b0c900a255dd4","created_at":"2026-09-09T10:35:00.720Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.740Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-17370ed6cf2b0c900a255dd4: start","job_status":"start","queue_duration_s":1.461197,"scheduling_latency_s":1.461211}1246gitlab # [ 238.662565] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.316Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"17370ed6cf2b0c900a255dd4","created_at":"2026-09-09T10:35:00.720Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.740Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-17370ed6cf2b0c900a255dd4: done: 0.114805 sec","job_status":"done","queue_duration_s":1.461197,"scheduling_latency_s":1.461211,"redis_calls":71,"redis_duration_s":0.017714999999999998,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002473,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001034,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013498,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00071,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032312,"duration_s":0.114805,"completed_at":"2026-09-09T10:35:02.316Z","load_balancing_strategy":"primary","db_duration_s":0.002714,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1247gitlab # [ 238.706378] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.318Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fc7069766c1a1ed543f7b7b5","created_at":"2026-09-09T10:35:00.762Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d02c888df5c7af40cfa26a70cd2f785","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.784Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fc7069766c1a1ed543f7b7b5: start","job_status":"start","queue_duration_s":1.534134,"scheduling_latency_s":1.53415}1248gitlab # [ 238.720694] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.330Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1249gitlab # [ 238.724340] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.337Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fc7069766c1a1ed543f7b7b5","created_at":"2026-09-09T10:35:00.762Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d02c888df5c7af40cfa26a70cd2f785","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.784Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fc7069766c1a1ed543f7b7b5: done: 0.019474 sec","job_status":"done","queue_duration_s":1.534134,"scheduling_latency_s":1.53415,"redis_calls":10,"redis_duration_s":0.002372,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00049,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001404,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032818,"duration_s":0.019474,"completed_at":"2026-09-09T10:35:02.337Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000631,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 238.766575] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"354e10ea388e0910936cc783","created_at":"2026-09-09T10:35:00.808Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9f88a81590deb6467706bc652e2456e","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.832Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-354e10ea388e0910936cc783: start","job_status":"start","queue_duration_s":1.506686,"scheduling_latency_s":1.506705}1251gitlab # [ 238.780890] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.369Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"354e10ea388e0910936cc783","created_at":"2026-09-09T10:35:00.808Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9f88a81590deb6467706bc652e2456e","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.832Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-354e10ea388e0910936cc783: done: 0.030213 sec","job_status":"done","queue_duration_s":1.506686,"scheduling_latency_s":1.506705,"redis_calls":10,"redis_duration_s":0.002532,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000517,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001485,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00053,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037566,"duration_s":0.030213,"completed_at":"2026-09-09T10:35:02.369Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 238.822517] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.370Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2bdda118dc3c6c3f5b974751","created_at":"2026-09-09T10:35:00.853Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15975eee5033e486b10262fa108dbb4f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.882Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2bdda118dc3c6c3f5b974751: start","job_status":"start","queue_duration_s":1.488192,"scheduling_latency_s":1.488207}1253gitlab # [ 238.836947] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.404Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2bdda118dc3c6c3f5b974751","created_at":"2026-09-09T10:35:00.853Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15975eee5033e486b10262fa108dbb4f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.882Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2bdda118dc3c6c3f5b974751: done: 0.033348 sec","job_status":"done","queue_duration_s":1.488192,"scheduling_latency_s":1.488207,"redis_calls":13,"redis_duration_s":0.0033629999999999997,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000489,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001723,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001151,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01060918,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.033348,"completed_at":"2026-09-09T10:35:02.404Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003964,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1254gitlab # [ 238.881850] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.405Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c9904bb8f52f359f1c477da4","created_at":"2026-09-09T10:35:00.915Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"369cbdea3ec7db6fda65f98707dda8af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.938Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c9904bb8f52f359f1c477da4: start","job_status":"start","queue_duration_s":1.467763,"scheduling_latency_s":1.467777}1255gitlab # [ 238.895357] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.434Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c9904bb8f52f359f1c477da4","created_at":"2026-09-09T10:35:00.915Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"369cbdea3ec7db6fda65f98707dda8af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:00.938Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c9904bb8f52f359f1c477da4: done: 0.028971 sec","job_status":"done","queue_duration_s":1.467763,"scheduling_latency_s":1.467777,"redis_calls":12,"redis_duration_s":0.0032530000000000002,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001459,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001314,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00054852,"exclusive_lock_hold_duration_s":0.008454439999999999,"duration_s":0.028971,"completed_at":"2026-09-09T10:35:02.434Z","load_balancing_strategy":"primary","db_duration_s":0.004784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256gitlab # [ 238.938782] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d54d4d0b2c9476af43e0d3e1","created_at":"2026-09-09T10:35:00.981Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ceace673b07e8707f2075370c46c791","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.007Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d54d4d0b2c9476af43e0d3e1: start","job_status":"start","queue_duration_s":1.4293,"scheduling_latency_s":1.429315}1257gitlab # [ 238.952882] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.695Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d54d4d0b2c9476af43e0d3e1","created_at":"2026-09-09T10:35:00.981Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ceace673b07e8707f2075370c46c791","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.007Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d54d4d0b2c9476af43e0d3e1: done: 0.259246 sec","job_status":"done","queue_duration_s":1.4293,"scheduling_latency_s":1.429315,"redis_calls":14,"redis_duration_s":0.00382,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001192,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001629,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.049,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.197938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055192,"exclusive_lock_hold_duration_s":0.23556200000000002,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.259246,"completed_at":"2026-09-09T10:35:02.695Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.069112,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 238.996322] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.697Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"eee827faddacc6405b7add20","created_at":"2026-09-09T10:35:01.072Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e496bd0de759663c4c15fc6b2eb58a3e","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.090Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-eee827faddacc6405b7add20: start","job_status":"start","queue_duration_s":1.606818,"scheduling_latency_s":1.606836}1259gitlab # [ 239.010235] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"eee827faddacc6405b7add20","created_at":"2026-09-09T10:35:01.072Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e496bd0de759663c4c15fc6b2eb58a3e","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.090Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-eee827faddacc6405b7add20: done: 0.050647 sec","job_status":"done","queue_duration_s":1.606818,"scheduling_latency_s":1.606836,"redis_calls":10,"redis_duration_s":0.003336,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000549,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050008,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.050647,"completed_at":"2026-09-09T10:35:02.748Z","load_balancing_strategy":"primary","db_duration_s":0.025556,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 239.052248] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.750Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c22d2b0a6511081f072814bf","created_at":"2026-09-09T10:35:01.113Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2dcab035d68571b74ed91944e5f5ff21","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.134Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c22d2b0a6511081f072814bf: start","job_status":"start","queue_duration_s":1.615431,"scheduling_latency_s":1.615452}1261gitlab # [ 239.066134] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.778Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c22d2b0a6511081f072814bf","created_at":"2026-09-09T10:35:01.113Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2dcab035d68571b74ed91944e5f5ff21","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.134Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c22d2b0a6511081f072814bf: done: 0.028609 sec","job_status":"done","queue_duration_s":1.615431,"scheduling_latency_s":1.615452,"redis_calls":10,"redis_duration_s":0.002626,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000549,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001526,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036776,"duration_s":0.028609,"completed_at":"2026-09-09T10:35:02.778Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 239.108960] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.780Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f6b38607b3db007d53313fad","created_at":"2026-09-09T10:35:01.157Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f517c9b84ec35fd5d492332dc0870a5","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.184Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f6b38607b3db007d53313fad: start","job_status":"start","queue_duration_s":1.596128,"scheduling_latency_s":1.596145}1263gitlab # [ 239.122943] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.818Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f6b38607b3db007d53313fad","created_at":"2026-09-09T10:35:01.157Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f517c9b84ec35fd5d492332dc0870a5","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.184Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f6b38607b3db007d53313fad: done: 0.038187 sec","job_status":"done","queue_duration_s":1.596128,"scheduling_latency_s":1.596145,"redis_calls":16,"redis_duration_s":0.003907,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002069,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001374,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031972,"duration_s":0.038187,"completed_at":"2026-09-09T10:35:02.818Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008259,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 239.164337] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.820Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"94bb934dfdb0560796f63b59","created_at":"2026-09-09T10:35:01.209Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cb012ba38dc47df5678e16503f793e6","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.233Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-94bb934dfdb0560796f63b59: start","job_status":"start","queue_duration_s":1.586944,"scheduling_latency_s":1.586959}1265gitlab # [ 239.178488] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.846Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"94bb934dfdb0560796f63b59","created_at":"2026-09-09T10:35:01.209Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cb012ba38dc47df5678e16503f793e6","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.233Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-94bb934dfdb0560796f63b59: done: 0.026856 sec","job_status":"done","queue_duration_s":1.586944,"scheduling_latency_s":1.586959,"redis_calls":12,"redis_duration_s":0.003392,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001417,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001505,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00053232,"exclusive_lock_hold_duration_s":0.00653546,"duration_s":0.026856,"completed_at":"2026-09-09T10:35:02.846Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003833,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266gitlab # [ 239.220159] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.848Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7e84fb53e43fb976d4e4c1b1","created_at":"2026-09-09T10:35:01.254Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cd2ab43fac8120a7853dc3b1ed16eb5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.275Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7e84fb53e43fb976d4e4c1b1: start","job_status":"start","queue_duration_s":1.573431,"scheduling_latency_s":1.573448}1267gitlab # [ 239.234281] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7e84fb53e43fb976d4e4c1b1","created_at":"2026-09-09T10:35:01.254Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cd2ab43fac8120a7853dc3b1ed16eb5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.275Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7e84fb53e43fb976d4e4c1b1: done: 0.039278 sec","job_status":"done","queue_duration_s":1.573431,"scheduling_latency_s":1.573448,"redis_calls":12,"redis_duration_s":0.0030210000000000002,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001473,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055802,"exclusive_lock_hold_duration_s":0.017941420000000003,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.039278,"completed_at":"2026-09-09T10:35:02.887Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008323,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268gitlab # [ 239.279489] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.889Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"74e0df3caf7c94d6846e870e","created_at":"2026-09-09T10:35:01.299Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2963f0e5147e82e8363231bfdb193e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:35:01.320Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-74e0df3caf7c94d6846e870e: start","job_status":"start","queue_duration_s":1.568723,"scheduling_latency_s":1.568739}1269gitlab # [ 239.292852] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.901Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1270gitlab # [ 239.296548] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.909Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"74e0df3caf7c94d6846e870e","created_at":"2026-09-09T10:35:01.299Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2963f0e5147e82e8363231bfdb193e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:35:01.320Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-74e0df3caf7c94d6846e870e: done: 0.020082 sec","job_status":"done","queue_duration_s":1.568723,"scheduling_latency_s":1.568739,"redis_calls":10,"redis_duration_s":0.002372,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000486,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000506,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033206,"duration_s":0.020082,"completed_at":"2026-09-09T10:35:02.909Z","load_balancing_strategy":"primary","db_duration_s":0.000561,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 239.337089] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"696bbf98d9f7c5b12671a79d","created_at":"2026-09-09T10:35:01.369Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30777535ff1e5c6e1958e8201f934229","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:35:01.389Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-696bbf98d9f7c5b12671a79d: start","job_status":"start","queue_duration_s":1.521316,"scheduling_latency_s":1.521335}1272gitlab # [ 239.350084] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.946Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"696bbf98d9f7c5b12671a79d","created_at":"2026-09-09T10:35:01.369Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30777535ff1e5c6e1958e8201f934229","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:35:01.389Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-696bbf98d9f7c5b12671a79d: done: 0.035404 sec","job_status":"done","queue_duration_s":1.521316,"scheduling_latency_s":1.521335,"redis_calls":10,"redis_duration_s":0.002588,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000476,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000537,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034016,"duration_s":0.035404,"completed_at":"2026-09-09T10:35:02.946Z","load_balancing_strategy":"primary","db_duration_s":0.006706,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1273gitlab # [ 239.390126] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.948Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1412b93d0d55dbe81caa0822","created_at":"2026-09-09T10:35:01.870Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-153f6f3a7cec43ba","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"beaeef9502efc082188e75bdb4b7627f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.895Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1412b93d0d55dbe81caa0822: start","job_status":"start","queue_duration_s":1.052231,"scheduling_latency_s":1.052248}1274gitlab # [ 239.402103] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.965Z","message":"No existing merge request to be cleaned up."}1275gitlab # [ 239.403736] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.980Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1412b93d0d55dbe81caa0822","created_at":"2026-09-09T10:35:01.870Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-153f6f3a7cec43ba","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"beaeef9502efc082188e75bdb4b7627f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.895Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1412b93d0d55dbe81caa0822: done: 0.032877 sec","job_status":"done","queue_duration_s":1.052231,"scheduling_latency_s":1.052248,"redis_calls":13,"redis_duration_s":0.003762,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00054,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001186,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000325,"duration_s":0.032877,"completed_at":"2026-09-09T10:35:02.980Z","load_balancing_strategy":"primary","db_duration_s":0.005462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1276gitlab # [ 239.443444] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.982Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"72c0140f9bb962e633a76098","created_at":"2026-09-09T10:35:01.870Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-153f6f3a7cec43ba","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"beaeef9502efc082188e75bdb4b7627f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.895Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-72c0140f9bb962e633a76098: start","job_status":"start","queue_duration_s":1.086658,"scheduling_latency_s":1.086673}1277gitlab # [ 239.455632] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:02.994Z","message":"No existing merge request to be cleaned up."}1278gitlab # [ 239.457362] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.003Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"72c0140f9bb962e633a76098","created_at":"2026-09-09T10:35:01.870Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-153f6f3a7cec43ba","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"beaeef9502efc082188e75bdb4b7627f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.895Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-72c0140f9bb962e633a76098: done: 0.021079 sec","job_status":"done","queue_duration_s":1.086658,"scheduling_latency_s":1.086673,"redis_calls":10,"redis_duration_s":0.002617,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001498,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021079,"completed_at":"2026-09-09T10:35:03.003Z","load_balancing_strategy":"primary","db_duration_s":0.002575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279gitlab # [ 239.496840] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.004Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"50d396d51bd339d75ecbb5ab","created_at":"2026-09-09T10:35:01.870Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-153f6f3a7cec43ba","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"beaeef9502efc082188e75bdb4b7627f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.895Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-50d396d51bd339d75ecbb5ab: start","job_status":"start","queue_duration_s":1.109155,"scheduling_latency_s":1.109171}1280gitlab # [ 239.508932] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.016Z","message":"No existing merge request to be cleaned up."}1281gitlab # [ 239.510549] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.026Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"50d396d51bd339d75ecbb5ab","created_at":"2026-09-09T10:35:01.870Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-153f6f3a7cec43ba","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"beaeef9502efc082188e75bdb4b7627f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.895Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-50d396d51bd339d75ecbb5ab: done: 0.021167 sec","job_status":"done","queue_duration_s":1.109155,"scheduling_latency_s":1.109171,"redis_calls":10,"redis_duration_s":0.002523,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001518,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021167,"completed_at":"2026-09-09T10:35:03.026Z","load_balancing_strategy":"primary","db_duration_s":0.002977,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 239.548273] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.027Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2daf4e523bb5dc523e59556e","created_at":"2026-09-09T10:35:01.870Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-153f6f3a7cec43ba","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"beaeef9502efc082188e75bdb4b7627f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.895Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2daf4e523bb5dc523e59556e: start","job_status":"start","queue_duration_s":1.13182,"scheduling_latency_s":1.131838}1283gitlab # [ 239.560222] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.039Z","message":"No existing merge request to be cleaned up."}1284gitlab # [ 239.561837] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.048Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2daf4e523bb5dc523e59556e","created_at":"2026-09-09T10:35:01.870Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-153f6f3a7cec43ba","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"beaeef9502efc082188e75bdb4b7627f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:01.895Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2daf4e523bb5dc523e59556e: done: 0.021024 sec","job_status":"done","queue_duration_s":1.13182,"scheduling_latency_s":1.131838,"redis_calls":10,"redis_duration_s":0.0028,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001265,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001535,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021024,"completed_at":"2026-09-09T10:35:03.048Z","load_balancing_strategy":"primary","db_duration_s":0.002882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 239.599665] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78d961e0a3260282b7ae1609","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78d961e0a3260282b7ae1609: start","job_status":"start","queue_duration_s":0.742887,"scheduling_latency_s":0.742903}1286gitlab # [ 239.612096] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78d961e0a3260282b7ae1609","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78d961e0a3260282b7ae1609: done: 0.023231 sec","job_status":"done","queue_duration_s":0.742887,"scheduling_latency_s":0.742903,"redis_calls":16,"redis_duration_s":0.0039000000000000003,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000691,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001146,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002063,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003377,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023231,"completed_at":"2026-09-09T10:35:03.073Z","load_balancing_strategy":"primary","db_duration_s":0.000714,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 239.652251] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"392a8e4d08e8c6dc19daa29a","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-392a8e4d08e8c6dc19daa29a: start","job_status":"start","queue_duration_s":0.767895,"scheduling_latency_s":0.767911}1288gitlab # [ 239.664171] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"392a8e4d08e8c6dc19daa29a","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-392a8e4d08e8c6dc19daa29a: done: 0.016027 sec","job_status":"done","queue_duration_s":0.767895,"scheduling_latency_s":0.767911,"redis_calls":13,"redis_duration_s":0.002734,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001831,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016027,"completed_at":"2026-09-09T10:35:03.090Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 239.703481] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85d1e5be1f5cede4aec9b16e","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85d1e5be1f5cede4aec9b16e: start","job_status":"start","queue_duration_s":0.785449,"scheduling_latency_s":0.785465}1290gitlab # [ 239.715911] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85d1e5be1f5cede4aec9b16e","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85d1e5be1f5cede4aec9b16e: done: 0.015927 sec","job_status":"done","queue_duration_s":0.785449,"scheduling_latency_s":0.785465,"redis_calls":13,"redis_duration_s":0.002784,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015927,"completed_at":"2026-09-09T10:35:03.108Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 239.754491] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c927e4f1b1f10ba8ed94e3f","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c927e4f1b1f10ba8ed94e3f: start","job_status":"start","queue_duration_s":0.803003,"scheduling_latency_s":0.803018}1292gitlab # [ 239.766807] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c927e4f1b1f10ba8ed94e3f","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c927e4f1b1f10ba8ed94e3f: done: 0.016112 sec","job_status":"done","queue_duration_s":0.803003,"scheduling_latency_s":0.803018,"redis_calls":13,"redis_duration_s":0.0027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001702,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016112,"completed_at":"2026-09-09T10:35:03.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 239.805599] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64bd4bcc0f1dab2ad1711dbf","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64bd4bcc0f1dab2ad1711dbf: start","job_status":"start","queue_duration_s":0.820343,"scheduling_latency_s":0.820541}1294gitlab # [ 239.818150] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64bd4bcc0f1dab2ad1711dbf","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64bd4bcc0f1dab2ad1711dbf: done: 0.015504 sec","job_status":"done","queue_duration_s":0.820343,"scheduling_latency_s":0.820541,"redis_calls":13,"redis_duration_s":0.001865,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015504,"completed_at":"2026-09-09T10:35:03.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 239.856803] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55c002b6d4f033288f99284f","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55c002b6d4f033288f99284f: start","job_status":"start","queue_duration_s":0.836906,"scheduling_latency_s":0.836923}1296gitlab # [ 239.869004] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55c002b6d4f033288f99284f","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55c002b6d4f033288f99284f: done: 0.015405 sec","job_status":"done","queue_duration_s":0.836906,"scheduling_latency_s":0.836923,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015405,"completed_at":"2026-09-09T10:35:03.159Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 239.908826] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51802bb182803a18e4976db4","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51802bb182803a18e4976db4: start","job_status":"start","queue_duration_s":0.853498,"scheduling_latency_s":0.853515}1298gitlab # [ 239.921093] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51802bb182803a18e4976db4","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51802bb182803a18e4976db4: done: 0.015136 sec","job_status":"done","queue_duration_s":0.853498,"scheduling_latency_s":0.853515,"redis_calls":13,"redis_duration_s":0.001658,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015136,"completed_at":"2026-09-09T10:35:03.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 239.959945] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1541c933764b5af31da83394","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1541c933764b5af31da83394: start","job_status":"start","queue_duration_s":0.869685,"scheduling_latency_s":0.8697}1300gitlab # [ 239.972533] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1541c933764b5af31da83394","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1541c933764b5af31da83394: done: 0.015218 sec","job_status":"done","queue_duration_s":0.869685,"scheduling_latency_s":0.8697,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015218,"completed_at":"2026-09-09T10:35:03.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 240.010918] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"185fb974e03897f08b89e664","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-185fb974e03897f08b89e664: start","job_status":"start","queue_duration_s":0.885964,"scheduling_latency_s":0.885981}1302gitlab # [ 240.023341] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"185fb974e03897f08b89e664","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-185fb974e03897f08b89e664: done: 0.015009 sec","job_status":"done","queue_duration_s":0.885964,"scheduling_latency_s":0.885981,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015009,"completed_at":"2026-09-09T10:35:03.207Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 240.062208] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"674bff537441128efa23cdde","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-674bff537441128efa23cdde: start","job_status":"start","queue_duration_s":0.90224,"scheduling_latency_s":0.902256}1304gitlab # [ 240.074447] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"674bff537441128efa23cdde","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-674bff537441128efa23cdde: done: 0.014792 sec","job_status":"done","queue_duration_s":0.90224,"scheduling_latency_s":0.902256,"redis_calls":13,"redis_duration_s":0.001453,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014792,"completed_at":"2026-09-09T10:35:03.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 240.114495] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaa6606c586c01ca360c7302","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaa6606c586c01ca360c7302: start","job_status":"start","queue_duration_s":0.918292,"scheduling_latency_s":0.918308}1306gitlab # [ 240.133390] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaa6606c586c01ca360c7302","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaa6606c586c01ca360c7302: done: 0.015217 sec","job_status":"done","queue_duration_s":0.918292,"scheduling_latency_s":0.918308,"redis_calls":13,"redis_duration_s":0.001413,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015217,"completed_at":"2026-09-09T10:35:03.240Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 240.180402] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f90d807bf8760a0bfef12b7d","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f90d807bf8760a0bfef12b7d: start","job_status":"start","queue_duration_s":0.934708,"scheduling_latency_s":0.934725}1308gitlab # [ 240.193199] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f90d807bf8760a0bfef12b7d","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f90d807bf8760a0bfef12b7d: done: 0.015431 sec","job_status":"done","queue_duration_s":0.934708,"scheduling_latency_s":0.934725,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015431,"completed_at":"2026-09-09T10:35:03.257Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 240.232679] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db7aeac8a74ba4a908496b96","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db7aeac8a74ba4a908496b96: start","job_status":"start","queue_duration_s":0.951386,"scheduling_latency_s":0.951403}1310gitlab # [ 240.245239] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db7aeac8a74ba4a908496b96","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db7aeac8a74ba4a908496b96: done: 0.014797 sec","job_status":"done","queue_duration_s":0.951386,"scheduling_latency_s":0.951403,"redis_calls":13,"redis_duration_s":0.0014039999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014797,"completed_at":"2026-09-09T10:35:03.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 240.284963] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11c2dace4d5bce6f2e4f9063","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11c2dace4d5bce6f2e4f9063: start","job_status":"start","queue_duration_s":0.967436,"scheduling_latency_s":0.967453}1312gitlab # [ 240.298494] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11c2dace4d5bce6f2e4f9063","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11c2dace4d5bce6f2e4f9063: done: 0.015418 sec","job_status":"done","queue_duration_s":0.967436,"scheduling_latency_s":0.967453,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015418,"completed_at":"2026-09-09T10:35:03.289Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 240.338257] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d38206d60199ca7584257a0a","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d38206d60199ca7584257a0a: start","job_status":"start","queue_duration_s":0.984122,"scheduling_latency_s":0.984138}1314gitlab # [ 240.350828] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d38206d60199ca7584257a0a","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d38206d60199ca7584257a0a: done: 0.015003 sec","job_status":"done","queue_duration_s":0.984122,"scheduling_latency_s":0.984138,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015003,"completed_at":"2026-09-09T10:35:03.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 240.390449] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55294a8449ea0c5e4a577076","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55294a8449ea0c5e4a577076: start","job_status":"start","queue_duration_s":1.000168,"scheduling_latency_s":1.000184}1316gitlab # [ 240.403032] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55294a8449ea0c5e4a577076","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55294a8449ea0c5e4a577076: done: 0.014981 sec","job_status":"done","queue_duration_s":1.000168,"scheduling_latency_s":1.000184,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014981,"completed_at":"2026-09-09T10:35:03.322Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 240.442583] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d03aa8f3c4446c822fbe3e9","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d03aa8f3c4446c822fbe3e9: start","job_status":"start","queue_duration_s":1.016173,"scheduling_latency_s":1.016189}1318gitlab # [ 240.454966] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d03aa8f3c4446c822fbe3e9","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d03aa8f3c4446c822fbe3e9: done: 0.015401 sec","job_status":"done","queue_duration_s":1.016173,"scheduling_latency_s":1.016189,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015401,"completed_at":"2026-09-09T10:35:03.338Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 240.494029] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff69e0d40ffcb8497f37a22b","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff69e0d40ffcb8497f37a22b: start","job_status":"start","queue_duration_s":1.032701,"scheduling_latency_s":1.032717}1320gitlab # [ 240.507381] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff69e0d40ffcb8497f37a22b","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff69e0d40ffcb8497f37a22b: done: 0.015508 sec","job_status":"done","queue_duration_s":1.032701,"scheduling_latency_s":1.032717,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015508,"completed_at":"2026-09-09T10:35:03.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 240.546606] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8490ab7dddadbafbb1eb8b4c","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8490ab7dddadbafbb1eb8b4c: start","job_status":"start","queue_duration_s":1.049261,"scheduling_latency_s":1.049277}1322gitlab # [ 240.559080] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8490ab7dddadbafbb1eb8b4c","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8490ab7dddadbafbb1eb8b4c: done: 0.014905 sec","job_status":"done","queue_duration_s":1.049261,"scheduling_latency_s":1.049277,"redis_calls":13,"redis_duration_s":0.00159,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014905,"completed_at":"2026-09-09T10:35:03.371Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 240.598307] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19201ce6f4ea80771e71425d","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19201ce6f4ea80771e71425d: start","job_status":"start","queue_duration_s":1.065258,"scheduling_latency_s":1.065274}1324gitlab # [ 240.610860] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19201ce6f4ea80771e71425d","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19201ce6f4ea80771e71425d: done: 0.014989 sec","job_status":"done","queue_duration_s":1.065258,"scheduling_latency_s":1.065274,"redis_calls":13,"redis_duration_s":0.001459,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014989,"completed_at":"2026-09-09T10:35:03.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 240.649835] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03e12faa4f77b080517f1635","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03e12faa4f77b080517f1635: start","job_status":"start","queue_duration_s":1.081491,"scheduling_latency_s":1.081508}1326gitlab # [ 240.662255] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03e12faa4f77b080517f1635","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03e12faa4f77b080517f1635: done: 0.014993 sec","job_status":"done","queue_duration_s":1.081491,"scheduling_latency_s":1.081508,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014993,"completed_at":"2026-09-09T10:35:03.403Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 240.701140] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"568bc6ea9fb0a36fa91748b3","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-568bc6ea9fb0a36fa91748b3: start","job_status":"start","queue_duration_s":1.097683,"scheduling_latency_s":1.0977}1328gitlab # [ 240.714508] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"568bc6ea9fb0a36fa91748b3","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-568bc6ea9fb0a36fa91748b3: done: 0.014643 sec","job_status":"done","queue_duration_s":1.097683,"scheduling_latency_s":1.0977,"redis_calls":13,"redis_duration_s":0.001413,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014643,"completed_at":"2026-09-09T10:35:03.419Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 240.753437] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d58db77d533db2949eca997","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d58db77d533db2949eca997: start","job_status":"start","queue_duration_s":1.113688,"scheduling_latency_s":1.113705}1330gitlab # [ 240.765942] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d58db77d533db2949eca997","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d58db77d533db2949eca997: done: 0.014994 sec","job_status":"done","queue_duration_s":1.113688,"scheduling_latency_s":1.113705,"redis_calls":13,"redis_duration_s":0.0014399999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014994,"completed_at":"2026-09-09T10:35:03.435Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 240.805155] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc51b2425bb828814174051f","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc51b2425bb828814174051f: start","job_status":"start","queue_duration_s":1.129909,"scheduling_latency_s":1.129926}1332gitlab # [ 240.817490] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc51b2425bb828814174051f","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc51b2425bb828814174051f: done: 0.017199 sec","job_status":"done","queue_duration_s":1.129909,"scheduling_latency_s":1.129926,"redis_calls":13,"redis_duration_s":0.001673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001131,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017199,"completed_at":"2026-09-09T10:35:03.454Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 240.856736] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"361979ba609723c107969f7e","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-361979ba609723c107969f7e: start","job_status":"start","queue_duration_s":1.148303,"scheduling_latency_s":1.14832}1334gitlab # [ 240.869077] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"361979ba609723c107969f7e","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-361979ba609723c107969f7e: done: 0.015414 sec","job_status":"done","queue_duration_s":1.148303,"scheduling_latency_s":1.14832,"redis_calls":13,"redis_duration_s":0.001456,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015414,"completed_at":"2026-09-09T10:35:03.470Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 240.910014] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ecc2c01109749f75a452d4f","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ecc2c01109749f75a452d4f: start","job_status":"start","queue_duration_s":1.164652,"scheduling_latency_s":1.164669}1336gitlab # [ 240.922700] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ecc2c01109749f75a452d4f","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ecc2c01109749f75a452d4f: done: 0.015256 sec","job_status":"done","queue_duration_s":1.164652,"scheduling_latency_s":1.164669,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015256,"completed_at":"2026-09-09T10:35:03.486Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 240.962167] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70653f9c3aeb8157eef3843f","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70653f9c3aeb8157eef3843f: start","job_status":"start","queue_duration_s":1.181048,"scheduling_latency_s":1.181063}1338gitlab # [ 240.974447] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70653f9c3aeb8157eef3843f","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70653f9c3aeb8157eef3843f: done: 0.015228 sec","job_status":"done","queue_duration_s":1.181048,"scheduling_latency_s":1.181063,"redis_calls":13,"redis_duration_s":0.00161,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015228,"completed_at":"2026-09-09T10:35:03.503Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 241.013575] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c793fe56cafa1e7fc79454f3","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c793fe56cafa1e7fc79454f3: start","job_status":"start","queue_duration_s":1.197571,"scheduling_latency_s":1.197588}1340gitlab # [ 241.026022] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c793fe56cafa1e7fc79454f3","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c793fe56cafa1e7fc79454f3: done: 0.01522 sec","job_status":"done","queue_duration_s":1.197571,"scheduling_latency_s":1.197588,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01522,"completed_at":"2026-09-09T10:35:03.519Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 241.064900] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.521Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0df87ba1b843b93969277a72","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0df87ba1b843b93969277a72: start","job_status":"start","queue_duration_s":1.213899,"scheduling_latency_s":1.21392}1342gitlab # [ 241.077447] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0df87ba1b843b93969277a72","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0df87ba1b843b93969277a72: done: 0.015108 sec","job_status":"done","queue_duration_s":1.213899,"scheduling_latency_s":1.21392,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015108,"completed_at":"2026-09-09T10:35:03.536Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 241.117479] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d63d47668955935f21b2f62","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d63d47668955935f21b2f62: start","job_status":"start","queue_duration_s":1.230068,"scheduling_latency_s":1.230084}1344gitlab # [ 241.129841] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d63d47668955935f21b2f62","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d63d47668955935f21b2f62: done: 0.016057 sec","job_status":"done","queue_duration_s":1.230068,"scheduling_latency_s":1.230084,"redis_calls":13,"redis_duration_s":0.0017760000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001203,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016057,"completed_at":"2026-09-09T10:35:03.553Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 241.169148] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbe31d51b149dca3ccb75e19","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbe31d51b149dca3ccb75e19: start","job_status":"start","queue_duration_s":1.247341,"scheduling_latency_s":1.247357}1346gitlab # [ 241.181460] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbe31d51b149dca3ccb75e19","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbe31d51b149dca3ccb75e19: done: 0.015043 sec","job_status":"done","queue_duration_s":1.247341,"scheduling_latency_s":1.247357,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015043,"completed_at":"2026-09-09T10:35:03.569Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 241.221003] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb9bb1f584340820c8d8ad74","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb9bb1f584340820c8d8ad74: start","job_status":"start","queue_duration_s":1.263575,"scheduling_latency_s":1.26359}1348gitlab # [ 241.233546] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb9bb1f584340820c8d8ad74","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb9bb1f584340820c8d8ad74: done: 0.015856 sec","job_status":"done","queue_duration_s":1.263575,"scheduling_latency_s":1.26359,"redis_calls":13,"redis_duration_s":0.001563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000615,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015856,"completed_at":"2026-09-09T10:35:03.586Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 241.272433] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"573262d54765974e1e505df0","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-573262d54765974e1e505df0: start","job_status":"start","queue_duration_s":1.280945,"scheduling_latency_s":1.280965}1350gitlab # [ 241.284780] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"573262d54765974e1e505df0","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-573262d54765974e1e505df0: done: 0.016179 sec","job_status":"done","queue_duration_s":1.280945,"scheduling_latency_s":1.280965,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016179,"completed_at":"2026-09-09T10:35:03.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 241.325588] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ee26be2b156600eb964daef","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ee26be2b156600eb964daef: start","job_status":"start","queue_duration_s":1.298376,"scheduling_latency_s":1.298393}1352gitlab # [ 241.338158] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ee26be2b156600eb964daef","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ee26be2b156600eb964daef: done: 0.015717 sec","job_status":"done","queue_duration_s":1.298376,"scheduling_latency_s":1.298393,"redis_calls":13,"redis_duration_s":0.001507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015717,"completed_at":"2026-09-09T10:35:03.621Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 241.377244] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0994ec704cde22ea77898762","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0994ec704cde22ea77898762: start","job_status":"start","queue_duration_s":1.315313,"scheduling_latency_s":1.315332}1354gitlab # [ 241.389705] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0994ec704cde22ea77898762","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0994ec704cde22ea77898762: done: 0.01515 sec","job_status":"done","queue_duration_s":1.315313,"scheduling_latency_s":1.315332,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01515,"completed_at":"2026-09-09T10:35:03.637Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 241.428388] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08957b832a3ab32b14b55df8","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08957b832a3ab32b14b55df8: start","job_status":"start","queue_duration_s":1.331543,"scheduling_latency_s":1.331559}1356gitlab # [ 241.440686] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08957b832a3ab32b14b55df8","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08957b832a3ab32b14b55df8: done: 0.015451 sec","job_status":"done","queue_duration_s":1.331543,"scheduling_latency_s":1.331559,"redis_calls":13,"redis_duration_s":0.001639,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001129,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015451,"completed_at":"2026-09-09T10:35:03.654Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 241.479842] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c6766b4510b2cd409f37f1a","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c6766b4510b2cd409f37f1a: start","job_status":"start","queue_duration_s":1.348024,"scheduling_latency_s":1.34804}1358gitlab # [ 241.492570] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c6766b4510b2cd409f37f1a","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c6766b4510b2cd409f37f1a: done: 0.015332 sec","job_status":"done","queue_duration_s":1.348024,"scheduling_latency_s":1.34804,"redis_calls":13,"redis_duration_s":0.001428,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015332,"completed_at":"2026-09-09T10:35:03.670Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 241.532878] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84b5d1e97b56e48d9d5f1168","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84b5d1e97b56e48d9d5f1168: start","job_status":"start","queue_duration_s":1.364452,"scheduling_latency_s":1.364467}1360gitlab # [ 241.545219] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"84b5d1e97b56e48d9d5f1168","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-84b5d1e97b56e48d9d5f1168: done: 0.015308 sec","job_status":"done","queue_duration_s":1.364452,"scheduling_latency_s":1.364467,"redis_calls":13,"redis_duration_s":0.0016619999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015308,"completed_at":"2026-09-09T10:35:03.686Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 241.584377] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16ce7dfcfcfc229063f927d1","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16ce7dfcfcfc229063f927d1: start","job_status":"start","queue_duration_s":1.3808,"scheduling_latency_s":1.380816}1362gitlab # [ 241.596845] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16ce7dfcfcfc229063f927d1","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16ce7dfcfcfc229063f927d1: done: 0.01507 sec","job_status":"done","queue_duration_s":1.3808,"scheduling_latency_s":1.380816,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01507,"completed_at":"2026-09-09T10:35:03.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 241.635650] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2730aa12f029e3ebd0c6e7ed","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2730aa12f029e3ebd0c6e7ed: start","job_status":"start","queue_duration_s":1.397003,"scheduling_latency_s":1.397018}1364gitlab # [ 241.648393] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2730aa12f029e3ebd0c6e7ed","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2730aa12f029e3ebd0c6e7ed: done: 0.015013 sec","job_status":"done","queue_duration_s":1.397003,"scheduling_latency_s":1.397018,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015013,"completed_at":"2026-09-09T10:35:03.719Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 241.687467] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a29480fb48089ade942612da","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a29480fb48089ade942612da: start","job_status":"start","queue_duration_s":1.41342,"scheduling_latency_s":1.413436}1366gitlab # [ 241.699884] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a29480fb48089ade942612da","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a29480fb48089ade942612da: done: 0.015187 sec","job_status":"done","queue_duration_s":1.41342,"scheduling_latency_s":1.413436,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015187,"completed_at":"2026-09-09T10:35:03.735Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 241.740460] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b06e932fba74010dd6681f4b","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b06e932fba74010dd6681f4b: start","job_status":"start","queue_duration_s":1.429896,"scheduling_latency_s":1.429913}1368gitlab # [ 241.752969] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b06e932fba74010dd6681f4b","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b06e932fba74010dd6681f4b: done: 0.015209 sec","job_status":"done","queue_duration_s":1.429896,"scheduling_latency_s":1.429913,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015209,"completed_at":"2026-09-09T10:35:03.752Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 241.792075] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5054211c4c56e926ea92da7d","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5054211c4c56e926ea92da7d: start","job_status":"start","queue_duration_s":1.446314,"scheduling_latency_s":1.44633}1370gitlab # [ 241.804212] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5054211c4c56e926ea92da7d","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5054211c4c56e926ea92da7d: done: 0.015122 sec","job_status":"done","queue_duration_s":1.446314,"scheduling_latency_s":1.44633,"redis_calls":13,"redis_duration_s":0.0014420000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015122,"completed_at":"2026-09-09T10:35:03.768Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 241.843606] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a63f0eb62586b23164d97f32","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a63f0eb62586b23164d97f32: start","job_status":"start","queue_duration_s":1.462701,"scheduling_latency_s":1.462718}1372gitlab # [ 241.856186] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a63f0eb62586b23164d97f32","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a63f0eb62586b23164d97f32: done: 0.015107 sec","job_status":"done","queue_duration_s":1.462701,"scheduling_latency_s":1.462718,"redis_calls":13,"redis_duration_s":0.00142,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015107,"completed_at":"2026-09-09T10:35:03.784Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 241.895259] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"579f2734a891575119aef5cc","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-579f2734a891575119aef5cc: start","job_status":"start","queue_duration_s":1.479029,"scheduling_latency_s":1.479046}1374gitlab # [ 241.908063] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"579f2734a891575119aef5cc","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-579f2734a891575119aef5cc: done: 0.014959 sec","job_status":"done","queue_duration_s":1.479029,"scheduling_latency_s":1.479046,"redis_calls":13,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014959,"completed_at":"2026-09-09T10:35:03.801Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 241.948244] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c6b0315ba67211f39910f5f","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c6b0315ba67211f39910f5f: start","job_status":"start","queue_duration_s":1.495065,"scheduling_latency_s":1.49508}1376gitlab # [ 241.960687] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c6b0315ba67211f39910f5f","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c6b0315ba67211f39910f5f: done: 0.015307 sec","job_status":"done","queue_duration_s":1.495065,"scheduling_latency_s":1.49508,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015307,"completed_at":"2026-09-09T10:35:03.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 241.999724] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2391295e42cf99d411e29fa5","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2391295e42cf99d411e29fa5: start","job_status":"start","queue_duration_s":1.511386,"scheduling_latency_s":1.511402}1378gitlab # [ 242.012056] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2391295e42cf99d411e29fa5","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2391295e42cf99d411e29fa5: done: 0.015186 sec","job_status":"done","queue_duration_s":1.511386,"scheduling_latency_s":1.511402,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015186,"completed_at":"2026-09-09T10:35:03.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 242.050465] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"752d342250f227974f580ba0","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-752d342250f227974f580ba0: start","job_status":"start","queue_duration_s":1.527706,"scheduling_latency_s":1.527725}1380gitlab # [ 242.062827] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"752d342250f227974f580ba0","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-752d342250f227974f580ba0: done: 0.015353 sec","job_status":"done","queue_duration_s":1.527706,"scheduling_latency_s":1.527725,"redis_calls":13,"redis_duration_s":0.001468,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015353,"completed_at":"2026-09-09T10:35:03.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 242.101675] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92c892b789dc0e352f3f21ba","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92c892b789dc0e352f3f21ba: start","job_status":"start","queue_duration_s":1.544108,"scheduling_latency_s":1.544126}1382gitlab # [ 242.113800] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92c892b789dc0e352f3f21ba","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92c892b789dc0e352f3f21ba: done: 0.015383 sec","job_status":"done","queue_duration_s":1.544108,"scheduling_latency_s":1.544126,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015383,"completed_at":"2026-09-09T10:35:03.866Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 242.153112] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d06607d6619d1499ff738769","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d06607d6619d1499ff738769: start","job_status":"start","queue_duration_s":1.560575,"scheduling_latency_s":1.560592}1384gitlab # [ 242.165386] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:03.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d06607d6619d1499ff738769","created_at":"2026-09-09T10:35:02.223Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-d240bdbfc6524183","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"edcdee08c6a5bd7dfe92c961e7636e79","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:35:02.307Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d06607d6619d1499ff738769: done: 0.015275 sec","job_status":"done","queue_duration_s":1.560575,"scheduling_latency_s":1.560592,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015275,"completed_at":"2026-09-09T10:35:03.882Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 242.203765] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:04.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ff865247e6949d72c8d7c9e1","created_at":"2026-09-09T10:35:04.044Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5c7a2c0d2ee6e9f6463080c43247e36","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:35:04.051Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ff865247e6949d72c8d7c9e1: start","job_status":"start","queue_duration_s":0.002529,"scheduling_latency_s":0.002582}1386gitlab # [ 242.217166] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:04.302Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1387gitlab # [ 242.220453] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:04.328Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ff865247e6949d72c8d7c9e1","created_at":"2026-09-09T10:35:04.044Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5c7a2c0d2ee6e9f6463080c43247e36","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:35:04.051Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ff865247e6949d72c8d7c9e1: done: 0.274643 sec","job_status":"done","queue_duration_s":0.002529,"scheduling_latency_s":0.002582,"redis_calls":7,"redis_duration_s":0.006562,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003391,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003171,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.274643,"completed_at":"2026-09-09T10:35:04.328Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 242.259113] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:04.392Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"f02e1eea1d8cce452cd9863e","created_at":"2026-09-09T10:35:04.277Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a869473d823770489ec6fd813870ebef","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:04.309Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-f02e1eea1d8cce452cd9863e: start","job_status":"start","queue_duration_s":0.082447,"scheduling_latency_s":0.0825}1389gitlab # [ 242.272448] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:04.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"f02e1eea1d8cce452cd9863e","created_at":"2026-09-09T10:35:04.277Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a869473d823770489ec6fd813870ebef","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:04.309Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-f02e1eea1d8cce452cd9863e: done: 0.145443 sec","job_status":"done","queue_duration_s":0.082447,"scheduling_latency_s":0.0825,"redis_calls":10,"redis_duration_s":0.003552,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000705,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000774,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006471,"duration_s":0.145443,"completed_at":"2026-09-09T10:35:04.537Z","load_balancing_strategy":"primary","db_duration_s":0.008494,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 242.312576] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:04.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"e30c2014bb7e4538daa12d9d","created_at":"2026-09-09T10:35:04.394Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13621dfb97d738fc8c8bcbe82c9d07af","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:04.404Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-e30c2014bb7e4538daa12d9d: start","job_status":"start","queue_duration_s":0.135716,"scheduling_latency_s":0.135754}1391gitlab # [ 242.326338] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:04.577Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"e30c2014bb7e4538daa12d9d","created_at":"2026-09-09T10:35:04.394Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13621dfb97d738fc8c8bcbe82c9d07af","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:04.404Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-e30c2014bb7e4538daa12d9d: done: 0.037361 sec","job_status":"done","queue_duration_s":0.135716,"scheduling_latency_s":0.135754,"redis_calls":11,"redis_duration_s":0.002691,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000472,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00132,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000428,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040866,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.037361,"completed_at":"2026-09-09T10:35:04.577Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000878,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 242.370719] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:04.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"490385b27ffb58c27064cac5","created_at":"2026-09-09T10:35:04.439Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1220e19561fa21183aa8332870ba5c61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:04.447Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-490385b27ffb58c27064cac5: start","job_status":"start","queue_duration_s":0.131262,"scheduling_latency_s":0.131287}1393gitlab # [ 242.385231] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:35:04.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"490385b27ffb58c27064cac5","created_at":"2026-09-09T10:35:04.439Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1220e19561fa21183aa8332870ba5c61","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-09T10:35:04.447Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-490385b27ffb58c27064cac5: done: 0.214962 sec","job_status":"done","queue_duration_s":0.131262,"scheduling_latency_s":0.131287,"redis_calls":12,"redis_duration_s":0.002101,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000381,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000808,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.188098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065668,"exclusive_lock_hold_duration_s":0.18385379999999998,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.214962,"completed_at":"2026-09-09T10:35:04.794Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017487,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1394gitlab # [ 272.738943] setup-gitlab-start[2956]: W, [2026-09-09T10:35:36.557078 #2956] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1395gitlab # [ 301.037596] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:04.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"9d0f98c572447173ccfb8f99","created_at":"2026-09-09T10:36:04.836Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"321b3e06cf8ccbe582c5c3a6a5c1b1e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:36:04.847Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-9d0f98c572447173ccfb8f99: start","job_status":"start","queue_duration_s":0.004438,"scheduling_latency_s":0.004665}1396gitlab # [ 301.126227] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:04.945Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1397gitlab # [ 301.145905] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:04.964Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"9d0f98c572447173ccfb8f99","created_at":"2026-09-09T10:36:04.836Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"321b3e06cf8ccbe582c5c3a6a5c1b1e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:36:04.847Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-9d0f98c572447173ccfb8f99: done: 0.112687 sec","job_status":"done","queue_duration_s":0.004438,"scheduling_latency_s":0.004665,"redis_calls":14,"redis_duration_s":0.0053,"redis_read_bytes":901,"redis_write_bytes":1314,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.002538,"redis_feature_flag_read_bytes":896,"redis_feature_flag_write_bytes":508,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00203,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000732,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.112687,"completed_at":"2026-09-09T10:36:04.964Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 301.231365] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:04.995Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"53037c888a357febdf6a64ea","created_at":"2026-09-09T10:36:04.898Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"143efeb269f98334e8e2d0f24b35074b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:04.989Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-53037c888a357febdf6a64ea: start","job_status":"start","queue_duration_s":0.005539,"scheduling_latency_s":0.005571}1399gitlab # [ 303.206739] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.024Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"53037c888a357febdf6a64ea","created_at":"2026-09-09T10:36:04.898Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"143efeb269f98334e8e2d0f24b35074b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:04.989Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-53037c888a357febdf6a64ea: done: 2.029358 sec","job_status":"done","queue_duration_s":0.005539,"scheduling_latency_s":0.005571,"redis_calls":563,"redis_duration_s":1.121199,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.008741,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":1.095289,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.915032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":2.029358,"completed_at":"2026-09-09T10:36:07.024Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 303.207317] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"49fbf83018fceb4b3faf3162","created_at":"2026-09-09T10:36:05.054Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"208c612d00b69be53b35cff5d9e60e47","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.066Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-49fbf83018fceb4b3faf3162: start","job_status":"start","queue_duration_s":1.960023,"scheduling_latency_s":1.960048}1401gitlab # [ 303.281363] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.042Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"49fbf83018fceb4b3faf3162","created_at":"2026-09-09T10:36:05.054Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"208c612d00b69be53b35cff5d9e60e47","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.066Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-49fbf83018fceb4b3faf3162: done: 0.016462 sec","job_status":"done","queue_duration_s":1.960023,"scheduling_latency_s":1.960048,"redis_calls":10,"redis_duration_s":0.002303,"redis_read_bytes":389,"redis_write_bytes":1078,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00065,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":247,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000459,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016462,"completed_at":"2026-09-09T10:36:07.042Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 303.949377] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.045Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"61a11cb1f14ee0ae07dcc7f5","created_at":"2026-09-09T10:36:05.084Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e7ce4f646c9209c96712aaf1a4a22a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.100Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-61a11cb1f14ee0ae07dcc7f5: start","job_status":"start","queue_duration_s":1.944714,"scheduling_latency_s":1.944736}1403gitlab # [ 303.949569] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"61a11cb1f14ee0ae07dcc7f5","created_at":"2026-09-09T10:36:05.084Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e7ce4f646c9209c96712aaf1a4a22a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.100Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-61a11cb1f14ee0ae07dcc7f5: done: 0.060442 sec","job_status":"done","queue_duration_s":1.944714,"scheduling_latency_s":1.944736,"redis_calls":17,"redis_duration_s":0.005469,"redis_read_bytes":400,"redis_write_bytes":4274,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000792,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":248,"redis_queues_calls":2,"redis_queues_duration_s":0.00062,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003206,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000851,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060442,"completed_at":"2026-09-09T10:36:07.105Z","load_balancing_strategy":"primary","db_duration_s":0.001815,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 304.618878] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.108Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"ee92a5bb493f45d2be07c351","created_at":"2026-09-09T10:36:05.158Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a250bd30d491388704160fb4f72ac1f","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.214Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-ee92a5bb493f45d2be07c351: start","job_status":"start","queue_duration_s":1.894213,"scheduling_latency_s":1.894259}1405gitlab # [ 304.619077] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.213Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"ee92a5bb493f45d2be07c351","created_at":"2026-09-09T10:36:05.158Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a250bd30d491388704160fb4f72ac1f","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.214Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-ee92a5bb493f45d2be07c351: done: 0.104368 sec","job_status":"done","queue_duration_s":1.894213,"scheduling_latency_s":1.894259,"redis_calls":10,"redis_duration_s":0.0043040000000000005,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000788,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002671,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000845,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009716,"extra.ci_runners_stale_machines_cleanup_cron_worker.status":"success","extra.ci_runners_stale_machines_cleanup_cron_worker.total_deleted":0,"extra.ci_runners_stale_machines_cleanup_cron_worker.batch_counts":[0],"duration_s":0.104368,"completed_at":"2026-09-09T10:36:07.213Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034443,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 305.290720] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.216Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"decdd5ee767dff8a8f957395","created_at":"2026-09-09T10:36:05.268Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec4dec5f414c5fa13da055fbd830bf06","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.298Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-decdd5ee767dff8a8f957395: start","job_status":"start","queue_duration_s":1.917986,"scheduling_latency_s":1.918028}1407gitlab # [ 305.975284] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"decdd5ee767dff8a8f957395","created_at":"2026-09-09T10:36:05.268Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec4dec5f414c5fa13da055fbd830bf06","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.298Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-decdd5ee767dff8a8f957395: done: 0.093487 sec","job_status":"done","queue_duration_s":1.917986,"scheduling_latency_s":1.918028,"redis_calls":10,"redis_duration_s":0.004442,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002073,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00165274,"exclusive_lock_hold_duration_s":0.0345303,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.093487,"completed_at":"2026-09-09T10:36:07.309Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.038668,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 306.709246] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9fb8394cbde3bbc88055dd06","created_at":"2026-09-09T10:36:05.369Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08723dfaba603ac4a9b035a50abd1bd7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.413Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9fb8394cbde3bbc88055dd06: start","job_status":"start","queue_duration_s":1.899923,"scheduling_latency_s":1.899963}1409gitlab # [ 306.709364] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.333Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1410gitlab # [ 306.709755] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.343Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9fb8394cbde3bbc88055dd06","created_at":"2026-09-09T10:36:05.369Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08723dfaba603ac4a9b035a50abd1bd7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.413Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9fb8394cbde3bbc88055dd06: done: 0.029867 sec","job_status":"done","queue_duration_s":1.899923,"scheduling_latency_s":1.899963,"redis_calls":8,"redis_duration_s":0.002757,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000351,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001724,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000682,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029867,"completed_at":"2026-09-09T10:36:07.343Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 306.791556] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.345Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"f6620bc2844dea2b46e2e6d0","created_at":"2026-09-09T10:36:05.463Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"843472e43f091beb5f85738167e56d54","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.526Z","job_size_bytes":3,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-f6620bc2844dea2b46e2e6d0: start","job_status":"start","queue_duration_s":1.818897,"scheduling_latency_s":1.818923}1412gitlab # [ 306.833275] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.373Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"f6620bc2844dea2b46e2e6d0","created_at":"2026-09-09T10:36:05.463Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"843472e43f091beb5f85738167e56d54","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.526Z","job_size_bytes":3,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-f6620bc2844dea2b46e2e6d0: done: 0.028235 sec","job_status":"done","queue_duration_s":1.818897,"scheduling_latency_s":1.818923,"redis_calls":10,"redis_duration_s":0.003043,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00068,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001746,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000617,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047612,"duration_s":0.028235,"completed_at":"2026-09-09T10:36:07.373Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000822,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 306.914154] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"defd1a6b74130cb287fd6c63","created_at":"2026-09-09T10:36:05.633Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"96f2f9aa9f79906fd21e4351ca0b13a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.661Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-defd1a6b74130cb287fd6c63: start","job_status":"start","queue_duration_s":1.714631,"scheduling_latency_s":1.714654}1414gitlab # [ 306.934946] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.387Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1415gitlab # [ 306.945007] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.395Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"defd1a6b74130cb287fd6c63","created_at":"2026-09-09T10:36:05.633Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"96f2f9aa9f79906fd21e4351ca0b13a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.661Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-defd1a6b74130cb287fd6c63: done: 0.019693 sec","job_status":"done","queue_duration_s":1.714631,"scheduling_latency_s":1.714654,"redis_calls":8,"redis_duration_s":0.0022630000000000003,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001448,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000555,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019693,"completed_at":"2026-09-09T10:36:07.395Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 307.031915] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.397Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3337a6bca4b1ba48d8dc2204","created_at":"2026-09-09T10:36:05.706Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e49b55ce9442d4feadacd46816ee3cfd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.731Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3337a6bca4b1ba48d8dc2204: start","job_status":"start","queue_duration_s":1.665828,"scheduling_latency_s":1.665848}1417gitlab # [ 307.049305] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.418Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1418gitlab # [ 307.053120] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.431Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3337a6bca4b1ba48d8dc2204","created_at":"2026-09-09T10:36:05.706Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e49b55ce9442d4feadacd46816ee3cfd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.731Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3337a6bca4b1ba48d8dc2204: done: 0.03407 sec","job_status":"done","queue_duration_s":1.665828,"scheduling_latency_s":1.665848,"redis_calls":8,"redis_duration_s":0.003655,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000383,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002368,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03407,"completed_at":"2026-09-09T10:36:07.431Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 307.095725] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.434Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"18cb1f0437fc86d4e6ac8418","created_at":"2026-09-09T10:36:05.804Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c05c0eed0c21c84c72a1c312a8983cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.854Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-18cb1f0437fc86d4e6ac8418: start","job_status":"start","queue_duration_s":1.580076,"scheduling_latency_s":1.580119}1420gitlab # [ 307.111915] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.465Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"18cb1f0437fc86d4e6ac8418","created_at":"2026-09-09T10:36:05.804Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c05c0eed0c21c84c72a1c312a8983cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:05.854Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-18cb1f0437fc86d4e6ac8418: done: 0.031116 sec","job_status":"done","queue_duration_s":1.580076,"scheduling_latency_s":1.580119,"redis_calls":8,"redis_duration_s":0.002742,"redis_read_bytes":133,"redis_write_bytes":879,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000314,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":103,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000662,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031116,"completed_at":"2026-09-09T10:36:07.465Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 307.156633] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.467Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"868bd8fe1360b0ff99846217","created_at":"2026-09-09T10:36:05.981Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5480c1d71084e237b05662a90be7d2e3","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.006Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-868bd8fe1360b0ff99846217: start","job_status":"start","queue_duration_s":1.460787,"scheduling_latency_s":1.460814}1422gitlab # [ 307.169765] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.489Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"868bd8fe1360b0ff99846217","created_at":"2026-09-09T10:36:05.981Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5480c1d71084e237b05662a90be7d2e3","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.006Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-868bd8fe1360b0ff99846217: done: 0.021701 sec","job_status":"done","queue_duration_s":1.460787,"scheduling_latency_s":1.460814,"redis_calls":11,"redis_duration_s":0.003051,"redis_read_bytes":138,"redis_write_bytes":877,"redis_cache_calls":3,"redis_cache_duration_s":0.000763,"redis_cache_read_bytes":5,"redis_cache_write_bytes":97,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":84,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001454,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00055,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021701,"completed_at":"2026-09-09T10:36:07.489Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 307.211581] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.491Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2e80e0d1aa48d2f6339d2790","created_at":"2026-09-09T10:36:06.051Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ee7ecbaf0872bb2ed56eff1d2a1a965","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.076Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2e80e0d1aa48d2f6339d2790: start","job_status":"start","queue_duration_s":1.415192,"scheduling_latency_s":1.415215}1424gitlab # [ 307.226116] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2e80e0d1aa48d2f6339d2790","created_at":"2026-09-09T10:36:06.051Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9ee7ecbaf0872bb2ed56eff1d2a1a965","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.076Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2e80e0d1aa48d2f6339d2790: done: 0.026477 sec","job_status":"done","queue_duration_s":1.415192,"scheduling_latency_s":1.415215,"redis_calls":10,"redis_duration_s":0.002459,"redis_read_bytes":135,"redis_write_bytes":1184,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":97,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001175,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00078442,"exclusive_lock_hold_duration_s":0.0052222,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.026477,"completed_at":"2026-09-09T10:36:07.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002708,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 307.268837] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.519Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"56ec629901485ed231e677be","created_at":"2026-09-09T10:36:06.131Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.142Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-56ec629901485ed231e677be: start","job_status":"start","queue_duration_s":1.376899,"scheduling_latency_s":1.376925}1426gitlab # [ 307.282354] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"56ec629901485ed231e677be","created_at":"2026-09-09T10:36:06.131Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.142Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-56ec629901485ed231e677be: done: 0.115761 sec","job_status":"done","queue_duration_s":1.376899,"scheduling_latency_s":1.376925,"redis_calls":65,"redis_duration_s":0.016102,"redis_read_bytes":748,"redis_write_bytes":41452,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.000817,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.000858,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013783,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000644,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.115761,"completed_at":"2026-09-09T10:36:07.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 307.325401] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"663277ca3bc971802d5ca1f6","created_at":"2026-09-09T10:36:06.161Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"346f282a5cd1685c4a594b5e0488b686","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.174Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-663277ca3bc971802d5ca1f6: start","job_status":"start","queue_duration_s":1.462451,"scheduling_latency_s":1.462469}1428gitlab # [ 307.340080] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.645Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1429gitlab # [ 307.343801] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.650Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"663277ca3bc971802d5ca1f6","created_at":"2026-09-09T10:36:06.161Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"346f282a5cd1685c4a594b5e0488b686","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.174Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-663277ca3bc971802d5ca1f6: done: 0.013713 sec","job_status":"done","queue_duration_s":1.462451,"scheduling_latency_s":1.462469,"redis_calls":8,"redis_duration_s":0.0019240000000000001,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000216,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001193,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000515,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013713,"completed_at":"2026-09-09T10:36:07.650Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 307.385976] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.652Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"6b018b34ef5ac7ca9af5c04f","created_at":"2026-09-09T10:36:06.198Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fcef5284fb9826af97db97ef1c83dd1","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.210Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-6b018b34ef5ac7ca9af5c04f: start","job_status":"start","queue_duration_s":1.442583,"scheduling_latency_s":1.4426}1431gitlab # [ 307.400506] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"6b018b34ef5ac7ca9af5c04f","created_at":"2026-09-09T10:36:06.198Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fcef5284fb9826af97db97ef1c83dd1","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.210Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-6b018b34ef5ac7ca9af5c04f: done: 0.018746 sec","job_status":"done","queue_duration_s":1.442583,"scheduling_latency_s":1.4426,"redis_calls":8,"redis_duration_s":0.002036,"redis_read_bytes":133,"redis_write_bytes":888,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000218,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001332,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000486,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018746,"completed_at":"2026-09-09T10:36:07.671Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 307.442250] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.673Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2470f21be02ce1aa615d3499","created_at":"2026-09-09T10:36:06.229Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34be395abba08b5ff46e851829fa3da5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.250Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2470f21be02ce1aa615d3499: start","job_status":"start","queue_duration_s":1.422734,"scheduling_latency_s":1.422751}1433gitlab # [ 307.456797] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.696Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2470f21be02ce1aa615d3499","created_at":"2026-09-09T10:36:06.229Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34be395abba08b5ff46e851829fa3da5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.250Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2470f21be02ce1aa615d3499: done: 0.022918 sec","job_status":"done","queue_duration_s":1.422734,"scheduling_latency_s":1.422751,"redis_calls":11,"redis_duration_s":0.002816,"redis_read_bytes":136,"redis_write_bytes":1339,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001509,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00619534,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.022918,"completed_at":"2026-09-09T10:36:07.696Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003691,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1434gitlab # [ 307.501930] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.697Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"beb77dcfbf74445df3df4bec","created_at":"2026-09-09T10:36:06.283Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09e0fb7ca2e5f8fe8a26ba0ea5c44c42","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.295Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-beb77dcfbf74445df3df4bec: start","job_status":"start","queue_duration_s":1.402207,"scheduling_latency_s":1.402223}1435gitlab # [ 307.515550] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.715Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"beb77dcfbf74445df3df4bec","created_at":"2026-09-09T10:36:06.283Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09e0fb7ca2e5f8fe8a26ba0ea5c44c42","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.295Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-beb77dcfbf74445df3df4bec: done: 0.018049 sec","job_status":"done","queue_duration_s":1.402207,"scheduling_latency_s":1.402223,"redis_calls":10,"redis_duration_s":0.002421,"redis_read_bytes":135,"redis_write_bytes":1167,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00023,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001102,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055412,"exclusive_lock_hold_duration_s":0.0036957,"duration_s":0.018049,"completed_at":"2026-09-09T10:36:07.715Z","load_balancing_strategy":"primary","db_duration_s":0.001547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 307.556775] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:07.717Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c63a2dcd9246d855f1845a4a","created_at":"2026-09-09T10:36:06.332Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4582e58b5559206d153dd4b12d01eb0c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.344Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c63a2dcd9246d855f1845a4a: start","job_status":"start","queue_duration_s":1.372437,"scheduling_latency_s":1.372454}1437gitlab # [ 307.570657] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.077Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c63a2dcd9246d855f1845a4a","created_at":"2026-09-09T10:36:06.332Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4582e58b5559206d153dd4b12d01eb0c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.344Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c63a2dcd9246d855f1845a4a: done: 0.359797 sec","job_status":"done","queue_duration_s":1.372437,"scheduling_latency_s":1.372454,"redis_calls":12,"redis_duration_s":0.004445,"redis_read_bytes":137,"redis_write_bytes":1346,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001372,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001341,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.056,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.287643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00116548,"exclusive_lock_hold_duration_s":0.32763514,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.359797,"completed_at":"2026-09-09T10:36:08.077Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.087526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 307.614620] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.078Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"df868b6c66a181267a9e0ac2","created_at":"2026-09-09T10:36:06.366Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ec2135fbab681de42a1d735ddec3297","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.388Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-df868b6c66a181267a9e0ac2: start","job_status":"start","queue_duration_s":1.690585,"scheduling_latency_s":1.690604}1439gitlab # [ 307.629249] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"df868b6c66a181267a9e0ac2","created_at":"2026-09-09T10:36:06.366Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ec2135fbab681de42a1d735ddec3297","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.388Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-df868b6c66a181267a9e0ac2: done: 0.027273 sec","job_status":"done","queue_duration_s":1.690585,"scheduling_latency_s":1.690604,"redis_calls":12,"redis_duration_s":0.008825,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000919,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005611,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002295,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032754,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.027273,"completed_at":"2026-09-09T10:36:08.105Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000586,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 307.674131] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.107Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"82b5c7d2cbb57558961fb148","created_at":"2026-09-09T10:36:06.472Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fc85ba4e728f6d2866646f6201ba5ff","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.493Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-82b5c7d2cbb57558961fb148: start","job_status":"start","queue_duration_s":1.61348,"scheduling_latency_s":1.613511}1441gitlab # [ 307.687863] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.138Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"82b5c7d2cbb57558961fb148","created_at":"2026-09-09T10:36:06.472Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7fc85ba4e728f6d2866646f6201ba5ff","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.493Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-82b5c7d2cbb57558961fb148: done: 0.031364 sec","job_status":"done","queue_duration_s":1.61348,"scheduling_latency_s":1.613511,"redis_calls":8,"redis_duration_s":0.002156,"redis_read_bytes":133,"redis_write_bytes":936,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000213,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001429,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.031364,"completed_at":"2026-09-09T10:36:08.138Z","load_balancing_strategy":"primary","db_duration_s":0.015746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 307.731038] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.140Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0ed94ce8107fe6c63d86aca7","created_at":"2026-09-09T10:36:06.516Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"479c783ed471b1565e68847ce9d13245","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.529Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0ed94ce8107fe6c63d86aca7: start","job_status":"start","queue_duration_s":1.610975,"scheduling_latency_s":1.610991}1443gitlab # [ 307.745486] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.156Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0ed94ce8107fe6c63d86aca7","created_at":"2026-09-09T10:36:06.516Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"479c783ed471b1565e68847ce9d13245","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.529Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0ed94ce8107fe6c63d86aca7: done: 0.016555 sec","job_status":"done","queue_duration_s":1.610975,"scheduling_latency_s":1.610991,"redis_calls":8,"redis_duration_s":0.001984,"redis_read_bytes":133,"redis_write_bytes":764,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00023,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001272,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016555,"completed_at":"2026-09-09T10:36:08.156Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 307.786703] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.158Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"3016effa6f6286eacbf0b4a3","created_at":"2026-09-09T10:36:06.547Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0770a29b17321b7fcc9a3bcf309b5fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.567Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-3016effa6f6286eacbf0b4a3: start","job_status":"start","queue_duration_s":1.590689,"scheduling_latency_s":1.590706}1445gitlab # [ 307.800330] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.193Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"3016effa6f6286eacbf0b4a3","created_at":"2026-09-09T10:36:06.547Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0770a29b17321b7fcc9a3bcf309b5fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.567Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-3016effa6f6286eacbf0b4a3: done: 0.03469 sec","job_status":"done","queue_duration_s":1.590689,"scheduling_latency_s":1.590706,"redis_calls":20,"redis_duration_s":0.004796,"redis_read_bytes":20,"redis_write_bytes":3248,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002052,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.000322,"redis_queues_read_bytes":3,"redis_queues_write_bytes":818,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001642,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00078,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033382,"duration_s":0.03469,"completed_at":"2026-09-09T10:36:08.193Z","load_balancing_strategy":"primary","db_duration_s":0.002484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 307.842384] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.194Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0b303bdbe3444178c069b955","created_at":"2026-09-09T10:36:06.586Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7160ced17e164e1cdcacd44936fb57da","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.598Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0b303bdbe3444178c069b955: start","job_status":"start","queue_duration_s":1.595755,"scheduling_latency_s":1.595772}1447gitlab # [ 307.856157] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.219Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0b303bdbe3444178c069b955","created_at":"2026-09-09T10:36:06.586Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7160ced17e164e1cdcacd44936fb57da","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.598Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0b303bdbe3444178c069b955: done: 0.024699 sec","job_status":"done","queue_duration_s":1.595755,"scheduling_latency_s":1.595772,"redis_calls":11,"redis_duration_s":0.00269,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001019,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001213,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024699,"completed_at":"2026-09-09T10:36:08.219Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006136,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 307.896530] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.220Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"16314cbffa37f9eac1069037","created_at":"2026-09-09T10:36:06.621Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15d24f9433122891a6c95f315e711b8d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.634Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-16314cbffa37f9eac1069037: start","job_status":"start","queue_duration_s":1.586651,"scheduling_latency_s":1.586668}1449gitlab # [ 307.911475] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.238Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"16314cbffa37f9eac1069037","created_at":"2026-09-09T10:36:06.621Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15d24f9433122891a6c95f315e711b8d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.634Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-16314cbffa37f9eac1069037: done: 0.017803 sec","job_status":"done","queue_duration_s":1.586651,"scheduling_latency_s":1.586668,"redis_calls":10,"redis_duration_s":0.002689,"redis_read_bytes":135,"redis_write_bytes":1227,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056426,"exclusive_lock_hold_duration_s":0.00306166,"duration_s":0.017803,"completed_at":"2026-09-09T10:36:08.238Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 307.952509] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"30e59743242714e9c8bb51d0","created_at":"2026-09-09T10:36:06.652Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"913450c152949b69125cd1025049ef7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.664Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-30e59743242714e9c8bb51d0: start","job_status":"start","queue_duration_s":1.575092,"scheduling_latency_s":1.575107}1451gitlab # [ 307.966332] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.291Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"30e59743242714e9c8bb51d0","created_at":"2026-09-09T10:36:06.652Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"913450c152949b69125cd1025049ef7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:06.664Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-30e59743242714e9c8bb51d0: done: 0.051718 sec","job_status":"done","queue_duration_s":1.575092,"scheduling_latency_s":1.575107,"redis_calls":11,"redis_duration_s":0.002866,"redis_read_bytes":263,"redis_write_bytes":1334,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00045,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":172,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001156,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000524,"exclusive_lock_hold_duration_s":0.03595552,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.051718,"completed_at":"2026-09-09T10:36:08.291Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 308.010121] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.293Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"09f0ba27a8722713a6b86175","created_at":"2026-09-09T10:36:06.686Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7070cbdfc7cd5e167d55da626b02a41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:36:06.698Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-09f0ba27a8722713a6b86175: start","job_status":"start","queue_duration_s":1.594786,"scheduling_latency_s":1.594803}1453gitlab # [ 308.023421] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.301Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1454gitlab # [ 308.027127] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.306Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"09f0ba27a8722713a6b86175","created_at":"2026-09-09T10:36:06.686Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7070cbdfc7cd5e167d55da626b02a41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:36:06.698Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-09f0ba27a8722713a6b86175: done: 0.013492 sec","job_status":"done","queue_duration_s":1.594786,"scheduling_latency_s":1.594803,"redis_calls":8,"redis_duration_s":0.0019089999999999999,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000215,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001238,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013492,"completed_at":"2026-09-09T10:36:08.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 308.067866] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.308Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"2dcef48273c0f40e15dbc779","created_at":"2026-09-09T10:36:06.739Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c4acc4dc6b4d240f45df4171f8df7faa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:36:06.751Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-2dcef48273c0f40e15dbc779: start","job_status":"start","queue_duration_s":1.557274,"scheduling_latency_s":1.55729}1456gitlab # [ 308.081257] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.330Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"2dcef48273c0f40e15dbc779","created_at":"2026-09-09T10:36:06.739Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-b4e7573200274bbb","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c4acc4dc6b4d240f45df4171f8df7faa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:36:06.751Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-2dcef48273c0f40e15dbc779: done: 0.02253 sec","job_status":"done","queue_duration_s":1.557274,"scheduling_latency_s":1.55729,"redis_calls":8,"redis_duration_s":0.001994,"redis_read_bytes":133,"redis_write_bytes":836,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000203,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02253,"completed_at":"2026-09-09T10:36:08.330Z","load_balancing_strategy":"primary","db_duration_s":0.002752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 308.122679] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.332Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3eea68e72f5923889d4f01f9","created_at":"2026-09-09T10:36:07.067Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-babc3382ce804233","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6e7ce4f646c9209c96712aaf1a4a22a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.092Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3eea68e72f5923889d4f01f9: start","job_status":"start","queue_duration_s":1.240292,"scheduling_latency_s":1.240309}1458gitlab # [ 308.135110] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.344Z","message":"No existing merge request to be cleaned up."}1459gitlab # [ 308.136846] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.353Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3eea68e72f5923889d4f01f9","created_at":"2026-09-09T10:36:07.067Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-babc3382ce804233","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6e7ce4f646c9209c96712aaf1a4a22a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.092Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3eea68e72f5923889d4f01f9: done: 0.020972 sec","job_status":"done","queue_duration_s":1.240292,"scheduling_latency_s":1.240309,"redis_calls":11,"redis_duration_s":0.002597,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001392,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020972,"completed_at":"2026-09-09T10:36:08.353Z","load_balancing_strategy":"primary","db_duration_s":0.002599,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 308.176663] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.354Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e8ec81be069261427e16407b","created_at":"2026-09-09T10:36:07.067Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-babc3382ce804233","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6e7ce4f646c9209c96712aaf1a4a22a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.092Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e8ec81be069261427e16407b: start","job_status":"start","queue_duration_s":1.262678,"scheduling_latency_s":1.262693}1461gitlab # [ 308.188677] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.365Z","message":"No existing merge request to be cleaned up."}1462gitlab # [ 308.190351] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.374Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e8ec81be069261427e16407b","created_at":"2026-09-09T10:36:07.067Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-babc3382ce804233","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6e7ce4f646c9209c96712aaf1a4a22a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.092Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e8ec81be069261427e16407b: done: 0.019464 sec","job_status":"done","queue_duration_s":1.262678,"scheduling_latency_s":1.262693,"redis_calls":10,"redis_duration_s":0.002434,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001421,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019464,"completed_at":"2026-09-09T10:36:08.374Z","load_balancing_strategy":"primary","db_duration_s":0.002298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 308.228057] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.375Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"84b2ad2c1f9d8c4d2478c811","created_at":"2026-09-09T10:36:07.067Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-babc3382ce804233","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6e7ce4f646c9209c96712aaf1a4a22a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.092Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-84b2ad2c1f9d8c4d2478c811: start","job_status":"start","queue_duration_s":1.283568,"scheduling_latency_s":1.283584}1464gitlab # [ 308.239934] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.386Z","message":"No existing merge request to be cleaned up."}1465gitlab # [ 308.241638] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.400Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"84b2ad2c1f9d8c4d2478c811","created_at":"2026-09-09T10:36:07.067Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-babc3382ce804233","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6e7ce4f646c9209c96712aaf1a4a22a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.092Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-84b2ad2c1f9d8c4d2478c811: done: 0.024491 sec","job_status":"done","queue_duration_s":1.283568,"scheduling_latency_s":1.283584,"redis_calls":10,"redis_duration_s":0.002955,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001309,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001646,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024491,"completed_at":"2026-09-09T10:36:08.400Z","load_balancing_strategy":"primary","db_duration_s":0.002195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 308.279834] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.403Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7d28b839e92acd07103d148a","created_at":"2026-09-09T10:36:07.067Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-babc3382ce804233","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6e7ce4f646c9209c96712aaf1a4a22a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.092Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7d28b839e92acd07103d148a: start","job_status":"start","queue_duration_s":1.311777,"scheduling_latency_s":1.31182}1467gitlab # [ 308.292147] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.430Z","message":"No existing merge request to be cleaned up."}1468gitlab # [ 308.293828] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.451Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7d28b839e92acd07103d148a","created_at":"2026-09-09T10:36:07.067Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-babc3382ce804233","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6e7ce4f646c9209c96712aaf1a4a22a3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.092Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7d28b839e92acd07103d148a: done: 0.047142 sec","job_status":"done","queue_duration_s":1.311777,"scheduling_latency_s":1.31182,"redis_calls":10,"redis_duration_s":0.004217,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00231,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047142,"completed_at":"2026-09-09T10:36:08.450Z","load_balancing_strategy":"primary","db_duration_s":0.0038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 308.332938] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12546801830b983afe9a6849","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12546801830b983afe9a6849: start","job_status":"start","queue_duration_s":0.825542,"scheduling_latency_s":0.82558}1470gitlab # [ 308.345050] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12546801830b983afe9a6849","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12546801830b983afe9a6849: done: 0.03148 sec","job_status":"done","queue_duration_s":0.825542,"scheduling_latency_s":0.82558,"redis_calls":14,"redis_duration_s":0.004111999999999999,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000281,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002603,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03148,"completed_at":"2026-09-09T10:36:08.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 308.385788] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59dd035fede473cf20259f57","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59dd035fede473cf20259f57: start","job_status":"start","queue_duration_s":0.859072,"scheduling_latency_s":0.859098}1472gitlab # [ 308.398182] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59dd035fede473cf20259f57","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59dd035fede473cf20259f57: done: 0.024786 sec","job_status":"done","queue_duration_s":0.859072,"scheduling_latency_s":0.859098,"redis_calls":13,"redis_duration_s":0.0034260000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00229,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024786,"completed_at":"2026-09-09T10:36:08.512Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 308.436694] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50e644187bb72d9a571159c7","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50e644187bb72d9a571159c7: start","job_status":"start","queue_duration_s":0.885714,"scheduling_latency_s":0.885735}1474gitlab # [ 308.448938] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50e644187bb72d9a571159c7","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50e644187bb72d9a571159c7: done: 0.021075 sec","job_status":"done","queue_duration_s":0.885714,"scheduling_latency_s":0.885735,"redis_calls":13,"redis_duration_s":0.003135,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002076,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021075,"completed_at":"2026-09-09T10:36:08.535Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 308.487386] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5736a62130e70afbe39e1ec2","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5736a62130e70afbe39e1ec2: start","job_status":"start","queue_duration_s":0.908458,"scheduling_latency_s":0.908478}1476gitlab # [ 308.499933] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5736a62130e70afbe39e1ec2","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5736a62130e70afbe39e1ec2: done: 0.021052 sec","job_status":"done","queue_duration_s":0.908458,"scheduling_latency_s":0.908478,"redis_calls":13,"redis_duration_s":0.002605,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001702,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021052,"completed_at":"2026-09-09T10:36:08.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 308.539927] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a07cfc292b6b8d0572db9693","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a07cfc292b6b8d0572db9693: start","job_status":"start","queue_duration_s":0.930898,"scheduling_latency_s":0.930917}1478gitlab # [ 308.552318] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a07cfc292b6b8d0572db9693","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a07cfc292b6b8d0572db9693: done: 0.016676 sec","job_status":"done","queue_duration_s":0.930898,"scheduling_latency_s":0.930917,"redis_calls":13,"redis_duration_s":0.001656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016676,"completed_at":"2026-09-09T10:36:08.575Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 308.591115] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9b843d9b5505be62083ab69","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9b843d9b5505be62083ab69: start","job_status":"start","queue_duration_s":0.948783,"scheduling_latency_s":0.948801}1480gitlab # [ 308.603368] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9b843d9b5505be62083ab69","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9b843d9b5505be62083ab69: done: 0.015527 sec","job_status":"done","queue_duration_s":0.948783,"scheduling_latency_s":0.948801,"redis_calls":13,"redis_duration_s":0.002411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001681,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015527,"completed_at":"2026-09-09T10:36:08.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 308.641716] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"028686a2e6008af38a740771","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-028686a2e6008af38a740771: start","job_status":"start","queue_duration_s":0.965722,"scheduling_latency_s":0.965738}1482gitlab # [ 308.653900] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"028686a2e6008af38a740771","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-028686a2e6008af38a740771: done: 0.015129 sec","job_status":"done","queue_duration_s":0.965722,"scheduling_latency_s":0.965738,"redis_calls":13,"redis_duration_s":0.002773,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001818,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015129,"completed_at":"2026-09-09T10:36:08.609Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 308.692116] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67afd7f742988af9fa2f3ceb","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67afd7f742988af9fa2f3ceb: start","job_status":"start","queue_duration_s":0.982203,"scheduling_latency_s":0.982219}1484gitlab # [ 308.704109] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67afd7f742988af9fa2f3ceb","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67afd7f742988af9fa2f3ceb: done: 0.015075 sec","job_status":"done","queue_duration_s":0.982203,"scheduling_latency_s":0.982219,"redis_calls":13,"redis_duration_s":0.002641,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001691,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015075,"completed_at":"2026-09-09T10:36:08.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 308.744303] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa35bdd83a1c851e0bc4e377","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa35bdd83a1c851e0bc4e377: start","job_status":"start","queue_duration_s":0.998666,"scheduling_latency_s":0.99868}1486gitlab # [ 308.756626] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa35bdd83a1c851e0bc4e377","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa35bdd83a1c851e0bc4e377: done: 0.015235 sec","job_status":"done","queue_duration_s":0.998666,"scheduling_latency_s":0.99868,"redis_calls":13,"redis_duration_s":0.002899,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015235,"completed_at":"2026-09-09T10:36:08.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 308.795345] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"824f0ef23086b79c4998a5ee","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-824f0ef23086b79c4998a5ee: start","job_status":"start","queue_duration_s":1.015161,"scheduling_latency_s":1.015177}1488gitlab # [ 308.807807] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"824f0ef23086b79c4998a5ee","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-824f0ef23086b79c4998a5ee: done: 0.01467 sec","job_status":"done","queue_duration_s":1.015161,"scheduling_latency_s":1.015177,"redis_calls":13,"redis_duration_s":0.002453,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001537,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01467,"completed_at":"2026-09-09T10:36:08.658Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 308.846997] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56e5891da48c85687396edbc","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56e5891da48c85687396edbc: start","job_status":"start","queue_duration_s":1.031045,"scheduling_latency_s":1.031059}1490gitlab # [ 308.859482] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56e5891da48c85687396edbc","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56e5891da48c85687396edbc: done: 0.015844 sec","job_status":"done","queue_duration_s":1.031045,"scheduling_latency_s":1.031059,"redis_calls":13,"redis_duration_s":0.00279,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001819,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015844,"completed_at":"2026-09-09T10:36:08.675Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 308.898400] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1eea26eff4c40c5a1fb8539","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1eea26eff4c40c5a1fb8539: start","job_status":"start","queue_duration_s":1.048271,"scheduling_latency_s":1.048286}1492gitlab # [ 308.910611] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1eea26eff4c40c5a1fb8539","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1eea26eff4c40c5a1fb8539: done: 0.015306 sec","job_status":"done","queue_duration_s":1.048271,"scheduling_latency_s":1.048286,"redis_calls":13,"redis_duration_s":0.002817,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015306,"completed_at":"2026-09-09T10:36:08.691Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 308.950773] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9560791970a30c09a3c00435","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9560791970a30c09a3c00435: start","job_status":"start","queue_duration_s":1.064981,"scheduling_latency_s":1.064997}1494gitlab # [ 308.963239] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9560791970a30c09a3c00435","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9560791970a30c09a3c00435: done: 0.015103 sec","job_status":"done","queue_duration_s":1.064981,"scheduling_latency_s":1.064997,"redis_calls":13,"redis_duration_s":0.002636,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001696,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015103,"completed_at":"2026-09-09T10:36:08.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 309.001791] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"202ebf8b53067de6f7a766c7","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-202ebf8b53067de6f7a766c7: start","job_status":"start","queue_duration_s":1.081469,"scheduling_latency_s":1.081484}1496gitlab # [ 309.014123] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"202ebf8b53067de6f7a766c7","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-202ebf8b53067de6f7a766c7: done: 0.015099 sec","job_status":"done","queue_duration_s":1.081469,"scheduling_latency_s":1.081484,"redis_calls":13,"redis_duration_s":0.002718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015099,"completed_at":"2026-09-09T10:36:08.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 309.052448] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17e07fa482281c4bc08b4556","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17e07fa482281c4bc08b4556: start","job_status":"start","queue_duration_s":1.09795,"scheduling_latency_s":1.097965}1498gitlab # [ 309.064609] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17e07fa482281c4bc08b4556","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17e07fa482281c4bc08b4556: done: 0.015033 sec","job_status":"done","queue_duration_s":1.09795,"scheduling_latency_s":1.097965,"redis_calls":13,"redis_duration_s":0.002618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001702,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015033,"completed_at":"2026-09-09T10:36:08.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 309.103220] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54008b267e0cc7d61e6064ad","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54008b267e0cc7d61e6064ad: start","job_status":"start","queue_duration_s":1.114327,"scheduling_latency_s":1.114342}1500gitlab # [ 309.115759] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54008b267e0cc7d61e6064ad","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54008b267e0cc7d61e6064ad: done: 0.015159 sec","job_status":"done","queue_duration_s":1.114327,"scheduling_latency_s":1.114342,"redis_calls":13,"redis_duration_s":0.002809,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001847,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015159,"completed_at":"2026-09-09T10:36:08.757Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 309.155703] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56ec70ab9fbdc2d52f092fa6","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56ec70ab9fbdc2d52f092fa6: start","job_status":"start","queue_duration_s":1.130873,"scheduling_latency_s":1.130888}1502gitlab # [ 309.167942] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56ec70ab9fbdc2d52f092fa6","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56ec70ab9fbdc2d52f092fa6: done: 0.015155 sec","job_status":"done","queue_duration_s":1.130873,"scheduling_latency_s":1.130888,"redis_calls":13,"redis_duration_s":0.002777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015155,"completed_at":"2026-09-09T10:36:08.774Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 309.206752] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4e6238f83731e31d6b2a20f","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4e6238f83731e31d6b2a20f: start","job_status":"start","queue_duration_s":1.148129,"scheduling_latency_s":1.148175}1504gitlab # [ 309.219044] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4e6238f83731e31d6b2a20f","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4e6238f83731e31d6b2a20f: done: 0.040056 sec","job_status":"done","queue_duration_s":1.148129,"scheduling_latency_s":1.148175,"redis_calls":13,"redis_duration_s":0.00493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001776,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003154,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040056,"completed_at":"2026-09-09T10:36:08.816Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 309.257635] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9010a31168404d322b08c96","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9010a31168404d322b08c96: start","job_status":"start","queue_duration_s":1.190917,"scheduling_latency_s":1.190951}1506gitlab # [ 309.269697] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9010a31168404d322b08c96","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9010a31168404d322b08c96: done: 0.031712 sec","job_status":"done","queue_duration_s":1.190917,"scheduling_latency_s":1.190951,"redis_calls":13,"redis_duration_s":0.0037920000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001291,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002501,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031712,"completed_at":"2026-09-09T10:36:08.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 309.309084] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb8ad5c35ad3409612c49029","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb8ad5c35ad3409612c49029: start","job_status":"start","queue_duration_s":1.224744,"scheduling_latency_s":1.224769}1508gitlab # [ 309.321467] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb8ad5c35ad3409612c49029","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb8ad5c35ad3409612c49029: done: 0.022134 sec","job_status":"done","queue_duration_s":1.224744,"scheduling_latency_s":1.224769,"redis_calls":13,"redis_duration_s":0.003209,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022134,"completed_at":"2026-09-09T10:36:08.875Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 309.361181] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb04ec85ee3ab15ecd98aab1","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb04ec85ee3ab15ecd98aab1: start","job_status":"start","queue_duration_s":1.248599,"scheduling_latency_s":1.24862}1510gitlab # [ 309.373575] redis[787]: 10 changes in 300 seconds. Saving...1511gitlab # [ 309.374561] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb04ec85ee3ab15ecd98aab1","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb04ec85ee3ab15ecd98aab1: done: 0.020933 sec","job_status":"done","queue_duration_s":1.248599,"scheduling_latency_s":1.24862,"redis_calls":13,"redis_duration_s":0.00297,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020933,"completed_at":"2026-09-09T10:36:08.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 309.413390] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83d39061431fda8cd0c85a27","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83d39061431fda8cd0c85a27: start","job_status":"start","queue_duration_s":1.271238,"scheduling_latency_s":1.271259}1513gitlab # [ 309.425714] redis[787]: Background saving started by pid 32951514gitlab # [ 309.426664] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83d39061431fda8cd0c85a27","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83d39061431fda8cd0c85a27: done: 0.067722 sec","job_status":"done","queue_duration_s":1.271238,"scheduling_latency_s":1.271259,"redis_calls":13,"redis_duration_s":0.0031139999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.067722,"completed_at":"2026-09-09T10:36:08.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 309.465580] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80420539baa71517e0d351ba","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80420539baa71517e0d351ba: start","job_status":"start","queue_duration_s":1.340475,"scheduling_latency_s":1.34049}1516gitlab # [ 309.478129] redis[3295]: BGSAVE done, 459 keys saved, 0 keys skipped, 121700 bytes written.1517gitlab # [ 309.479353] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80420539baa71517e0d351ba","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80420539baa71517e0d351ba: done: 0.015356 sec","job_status":"done","queue_duration_s":1.340475,"scheduling_latency_s":1.34049,"redis_calls":13,"redis_duration_s":0.0028190000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015356,"completed_at":"2026-09-09T10:36:08.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 309.518602] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:08.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9fb08f5e8dcebe4ab91947a","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9fb08f5e8dcebe4ab91947a: start","job_status":"start","queue_duration_s":1.357189,"scheduling_latency_s":1.357204}1519gitlab # [ 309.530913] redis[3295]: DB saved on disk1520gitlab # [ 309.531623] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9fb08f5e8dcebe4ab91947a","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9fb08f5e8dcebe4ab91947a: done: 0.015897 sec","job_status":"done","queue_duration_s":1.357189,"scheduling_latency_s":1.357204,"redis_calls":13,"redis_duration_s":0.0027429999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001834,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015897,"completed_at":"2026-09-09T10:36:09.001Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 309.571233] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51b70616099322a788bfcceb","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51b70616099322a788bfcceb: start","job_status":"start","queue_duration_s":1.375425,"scheduling_latency_s":1.375441}1522gitlab # [ 309.583393] redis[3295]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1523gitlab # [ 309.584520] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51b70616099322a788bfcceb","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51b70616099322a788bfcceb: done: 0.016323 sec","job_status":"done","queue_duration_s":1.375425,"scheduling_latency_s":1.375441,"redis_calls":13,"redis_duration_s":0.002725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016323,"completed_at":"2026-09-09T10:36:09.020Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 309.622667] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f83ad4c838c322fd342b9751","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f83ad4c838c322fd342b9751: start","job_status":"start","queue_duration_s":1.393063,"scheduling_latency_s":1.393078}1525gitlab # [ 309.635006] redis[787]: Background saving terminated with success1526gitlab # [ 309.635975] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f83ad4c838c322fd342b9751","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f83ad4c838c322fd342b9751: done: 0.016387 sec","job_status":"done","queue_duration_s":1.393063,"scheduling_latency_s":1.393078,"redis_calls":13,"redis_duration_s":0.0028780000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016387,"completed_at":"2026-09-09T10:36:09.037Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 309.674710] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a70a08323db8e9ec9ba5a25b","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a70a08323db8e9ec9ba5a25b: start","job_status":"start","queue_duration_s":1.410782,"scheduling_latency_s":1.410796}1528gitlab # [ 309.687138] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a70a08323db8e9ec9ba5a25b","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a70a08323db8e9ec9ba5a25b: done: 0.016599 sec","job_status":"done","queue_duration_s":1.410782,"scheduling_latency_s":1.410796,"redis_calls":13,"redis_duration_s":0.002653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001667,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016599,"completed_at":"2026-09-09T10:36:09.055Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 309.726012] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a4916f535edc9ca21faa4d6","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a4916f535edc9ca21faa4d6: start","job_status":"start","queue_duration_s":1.428768,"scheduling_latency_s":1.428783}1530gitlab # [ 309.738260] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a4916f535edc9ca21faa4d6","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a4916f535edc9ca21faa4d6: done: 0.028803 sec","job_status":"done","queue_duration_s":1.428768,"scheduling_latency_s":1.428783,"redis_calls":13,"redis_duration_s":0.00507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001261,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003809,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028803,"completed_at":"2026-09-09T10:36:09.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 309.777548] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26d684b0901b54ffe84b0b5a","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26d684b0901b54ffe84b0b5a: start","job_status":"start","queue_duration_s":1.460609,"scheduling_latency_s":1.460647}1532gitlab # [ 309.790111] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26d684b0901b54ffe84b0b5a","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26d684b0901b54ffe84b0b5a: done: 0.037173 sec","job_status":"done","queue_duration_s":1.460609,"scheduling_latency_s":1.460647,"redis_calls":13,"redis_duration_s":0.004144,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001417,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037173,"completed_at":"2026-09-09T10:36:09.125Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 309.828573] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29b763245dedab3ff0ef4bb5","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29b763245dedab3ff0ef4bb5: start","job_status":"start","queue_duration_s":1.500037,"scheduling_latency_s":1.500061}1534gitlab # [ 309.840862] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29b763245dedab3ff0ef4bb5","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29b763245dedab3ff0ef4bb5: done: 0.02615 sec","job_status":"done","queue_duration_s":1.500037,"scheduling_latency_s":1.500061,"redis_calls":13,"redis_duration_s":0.003635,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001142,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002493,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02615,"completed_at":"2026-09-09T10:36:09.154Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 309.879064] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1eda8ec1f334e169b7cce8b9","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1eda8ec1f334e169b7cce8b9: start","job_status":"start","queue_duration_s":1.52916,"scheduling_latency_s":1.529183}1536gitlab # [ 309.891100] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1eda8ec1f334e169b7cce8b9","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1eda8ec1f334e169b7cce8b9: done: 0.024104 sec","job_status":"done","queue_duration_s":1.52916,"scheduling_latency_s":1.529183,"redis_calls":13,"redis_duration_s":0.003275,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001126,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002149,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024104,"completed_at":"2026-09-09T10:36:09.181Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 309.929434] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c96f4bf3e6df567b605836f","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c96f4bf3e6df567b605836f: start","job_status":"start","queue_duration_s":1.555044,"scheduling_latency_s":1.555065}1538gitlab # [ 309.941797] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c96f4bf3e6df567b605836f","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c96f4bf3e6df567b605836f: done: 0.020884 sec","job_status":"done","queue_duration_s":1.555044,"scheduling_latency_s":1.555065,"redis_calls":13,"redis_duration_s":0.0031599999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020884,"completed_at":"2026-09-09T10:36:09.204Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 309.981541] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43eb0508275a22a5cdbb0f12","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43eb0508275a22a5cdbb0f12: start","job_status":"start","queue_duration_s":1.577422,"scheduling_latency_s":1.577438}1540gitlab # [ 309.993789] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43eb0508275a22a5cdbb0f12","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43eb0508275a22a5cdbb0f12: done: 0.017699 sec","job_status":"done","queue_duration_s":1.577422,"scheduling_latency_s":1.577438,"redis_calls":13,"redis_duration_s":0.00286,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000997,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017699,"completed_at":"2026-09-09T10:36:09.223Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 310.032104] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7da2b0447b3ddd5767e9164b","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7da2b0447b3ddd5767e9164b: start","job_status":"start","queue_duration_s":1.597411,"scheduling_latency_s":1.597426}1542gitlab # [ 310.044220] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7da2b0447b3ddd5767e9164b","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7da2b0447b3ddd5767e9164b: done: 0.016645 sec","job_status":"done","queue_duration_s":1.597411,"scheduling_latency_s":1.597426,"redis_calls":13,"redis_duration_s":0.0029059999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016645,"completed_at":"2026-09-09T10:36:09.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 310.082729] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db90a7621e2a6869a9dce258","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db90a7621e2a6869a9dce258: start","job_status":"start","queue_duration_s":1.615283,"scheduling_latency_s":1.615298}1544gitlab # [ 310.094903] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db90a7621e2a6869a9dce258","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db90a7621e2a6869a9dce258: done: 0.01605 sec","job_status":"done","queue_duration_s":1.615283,"scheduling_latency_s":1.615298,"redis_calls":13,"redis_duration_s":0.002822,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001861,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01605,"completed_at":"2026-09-09T10:36:09.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 310.134478] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52119f57b776975411ee81c3","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52119f57b776975411ee81c3: start","job_status":"start","queue_duration_s":1.632679,"scheduling_latency_s":1.632694}1546gitlab # [ 310.146700] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52119f57b776975411ee81c3","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52119f57b776975411ee81c3: done: 0.016234 sec","job_status":"done","queue_duration_s":1.632679,"scheduling_latency_s":1.632694,"redis_calls":13,"redis_duration_s":0.0031190000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001336,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001783,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016234,"completed_at":"2026-09-09T10:36:09.277Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 310.186341] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8ac16379434d389246a0a52","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8ac16379434d389246a0a52: start","job_status":"start","queue_duration_s":1.651119,"scheduling_latency_s":1.651148}1548gitlab # [ 310.198724] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8ac16379434d389246a0a52","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8ac16379434d389246a0a52: done: 0.015619 sec","job_status":"done","queue_duration_s":1.651119,"scheduling_latency_s":1.651148,"redis_calls":13,"redis_duration_s":0.002632,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001738,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015619,"completed_at":"2026-09-09T10:36:09.295Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 310.237385] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9d8a9fdeced6231b338f861","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9d8a9fdeced6231b338f861: start","job_status":"start","queue_duration_s":1.668078,"scheduling_latency_s":1.668094}1550gitlab # [ 310.249601] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9d8a9fdeced6231b338f861","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9d8a9fdeced6231b338f861: done: 0.015756 sec","job_status":"done","queue_duration_s":1.668078,"scheduling_latency_s":1.668094,"redis_calls":13,"redis_duration_s":0.002696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001773,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015756,"completed_at":"2026-09-09T10:36:09.312Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 310.288536] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0146f0f541a77b7c05cc944","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0146f0f541a77b7c05cc944: start","job_status":"start","queue_duration_s":1.685181,"scheduling_latency_s":1.685197}1552gitlab # [ 310.300844] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0146f0f541a77b7c05cc944","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0146f0f541a77b7c05cc944: done: 0.015908 sec","job_status":"done","queue_duration_s":1.685181,"scheduling_latency_s":1.685197,"redis_calls":13,"redis_duration_s":0.0027730000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015908,"completed_at":"2026-09-09T10:36:09.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 310.339572] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a96e62bcbeb5945c67668747","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a96e62bcbeb5945c67668747: start","job_status":"start","queue_duration_s":1.703225,"scheduling_latency_s":1.703242}1554gitlab # [ 310.352045] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a96e62bcbeb5945c67668747","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a96e62bcbeb5945c67668747: done: 0.039068 sec","job_status":"done","queue_duration_s":1.703225,"scheduling_latency_s":1.703242,"redis_calls":13,"redis_duration_s":0.006555999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003205,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003351,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039068,"completed_at":"2026-09-09T10:36:09.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 310.390518] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6ca1514537dbe03dec548ca","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6ca1514537dbe03dec548ca: start","job_status":"start","queue_duration_s":1.745325,"scheduling_latency_s":1.745366}1556gitlab # [ 310.403676] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6ca1514537dbe03dec548ca","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6ca1514537dbe03dec548ca: done: 0.033395 sec","job_status":"done","queue_duration_s":1.745325,"scheduling_latency_s":1.745366,"redis_calls":13,"redis_duration_s":0.0052250000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001249,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033395,"completed_at":"2026-09-09T10:36:09.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 310.442322] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d75011022a9fefecb499729","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d75011022a9fefecb499729: start","job_status":"start","queue_duration_s":1.780663,"scheduling_latency_s":1.780687}1558gitlab # [ 310.454508] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d75011022a9fefecb499729","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d75011022a9fefecb499729: done: 0.02373 sec","job_status":"done","queue_duration_s":1.780663,"scheduling_latency_s":1.780687,"redis_calls":13,"redis_duration_s":0.003429,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002314,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02373,"completed_at":"2026-09-09T10:36:09.432Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 310.492837] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8f984600770c1e345f0ea2a","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8f984600770c1e345f0ea2a: start","job_status":"start","queue_duration_s":1.81237,"scheduling_latency_s":1.812395}1560gitlab # [ 310.504794] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8f984600770c1e345f0ea2a","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8f984600770c1e345f0ea2a: done: 0.022662 sec","job_status":"done","queue_duration_s":1.81237,"scheduling_latency_s":1.812395,"redis_calls":13,"redis_duration_s":0.00314,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022662,"completed_at":"2026-09-09T10:36:09.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 310.543060] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8845e2373d37e8c857d89d59","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8845e2373d37e8c857d89d59: start","job_status":"start","queue_duration_s":1.836784,"scheduling_latency_s":1.836803}1562gitlab # [ 310.555447] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8845e2373d37e8c857d89d59","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8845e2373d37e8c857d89d59: done: 0.020292 sec","job_status":"done","queue_duration_s":1.836784,"scheduling_latency_s":1.836803,"redis_calls":13,"redis_duration_s":0.0031009999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020292,"completed_at":"2026-09-09T10:36:09.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 310.593977] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf5f4c3840e38d7b1eb41add","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf5f4c3840e38d7b1eb41add: start","job_status":"start","queue_duration_s":1.858594,"scheduling_latency_s":1.858611}1564gitlab # [ 310.607171] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf5f4c3840e38d7b1eb41add","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf5f4c3840e38d7b1eb41add: done: 0.017452 sec","job_status":"done","queue_duration_s":1.858594,"scheduling_latency_s":1.858611,"redis_calls":13,"redis_duration_s":0.00285,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017452,"completed_at":"2026-09-09T10:36:09.504Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 310.645477] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"737f517434b901733d17507c","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-737f517434b901733d17507c: start","job_status":"start","queue_duration_s":1.877503,"scheduling_latency_s":1.877518}1566gitlab # [ 310.657499] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.521Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"737f517434b901733d17507c","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-737f517434b901733d17507c: done: 0.016041 sec","job_status":"done","queue_duration_s":1.877503,"scheduling_latency_s":1.877518,"redis_calls":13,"redis_duration_s":0.002754,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016041,"completed_at":"2026-09-09T10:36:09.521Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 310.696429] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe899da9b41ee7446a20790c","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe899da9b41ee7446a20790c: start","job_status":"start","queue_duration_s":1.896646,"scheduling_latency_s":1.896661}1568gitlab # [ 310.708328] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe899da9b41ee7446a20790c","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe899da9b41ee7446a20790c: done: 0.016323 sec","job_status":"done","queue_duration_s":1.896646,"scheduling_latency_s":1.896661,"redis_calls":13,"redis_duration_s":0.002699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001754,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016323,"completed_at":"2026-09-09T10:36:09.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 310.746696] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a2ca6d0c82484158b047f8d","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a2ca6d0c82484158b047f8d: start","job_status":"start","queue_duration_s":1.914349,"scheduling_latency_s":1.914364}1570gitlab # [ 310.759110] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a2ca6d0c82484158b047f8d","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a2ca6d0c82484158b047f8d: done: 0.016595 sec","job_status":"done","queue_duration_s":1.914349,"scheduling_latency_s":1.914364,"redis_calls":13,"redis_duration_s":0.00281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001798,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016595,"completed_at":"2026-09-09T10:36:09.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 310.797233] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6458cb61a3cdeb415f5fb93e","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6458cb61a3cdeb415f5fb93e: start","job_status":"start","queue_duration_s":1.932345,"scheduling_latency_s":1.93236}1572gitlab # [ 310.810347] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6458cb61a3cdeb415f5fb93e","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6458cb61a3cdeb415f5fb93e: done: 0.016609 sec","job_status":"done","queue_duration_s":1.932345,"scheduling_latency_s":1.93236,"redis_calls":13,"redis_duration_s":0.002881,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016609,"completed_at":"2026-09-09T10:36:09.577Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 310.849029] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ebecbfd77e0c4c80af74900","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ebecbfd77e0c4c80af74900: start","job_status":"start","queue_duration_s":1.951719,"scheduling_latency_s":1.951735}1574gitlab # [ 310.861307] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ebecbfd77e0c4c80af74900","created_at":"2026-09-09T10:36:07.536Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-c6e6e1e067404802","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"10ff8fb603b196b65afc4f86847b2a07","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:07.628Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ebecbfd77e0c4c80af74900: done: 0.040578 sec","job_status":"done","queue_duration_s":1.951719,"scheduling_latency_s":1.951735,"redis_calls":13,"redis_duration_s":0.006949,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004158,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002791,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040578,"completed_at":"2026-09-09T10:36:09.620Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 310.900522] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"d0edf0d76874369cda874ff4","created_at":"2026-09-09T10:36:08.177Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-5f45b57c52ba47c1","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"d0770a29b17321b7fcc9a3bcf309b5fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:08.185Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-d0edf0d76874369cda874ff4: start","job_status":"start","queue_duration_s":1.438224,"scheduling_latency_s":1.438293}1576gitlab # [ 310.913106] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:09.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"d0edf0d76874369cda874ff4","created_at":"2026-09-09T10:36:08.177Z","trace_propagation_headers":{"sentry-trace":"b94b5cfc51e9448bbac48793d2f1c710-5f45b57c52ba47c1","baggage":"sentry-trace_id=b94b5cfc51e9448bbac48793d2f1c710,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"d0770a29b17321b7fcc9a3bcf309b5fb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:08.185Z","job_size_bytes":2,"pid":2016,"sidekiq_tid":"maos","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-d0edf0d76874369cda874ff4: done: 0.093253 sec","job_status":"done","queue_duration_s":1.438224,"scheduling_latency_s":1.438293,"redis_calls":13,"redis_duration_s":0.006261,"redis_read_bytes":12,"redis_write_bytes":1665,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000895,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00092652,"duration_s":0.093253,"completed_at":"2026-09-09T10:36:09.716Z","load_balancing_strategy":"primary","db_duration_s":0.012902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 311.079801] postgres[861]: [861] LOG: checkpoint starting: time1578gitlab # [ 311.698862] gitaly[903]: time="2026-09-09T10:36:15.516Z" level=info msg="burden monitor stats" pid=9031579gitlab # [ 315.076746] postgres[3294]: [3294] ERROR: relation "table_without_models" does not exist1580gitlab # [ 315.077063] postgres[3294]: [3294] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1581gitlab # [ 320.604694] runuser[2955]: pam_unix(runuser:session): session closed for user gitlab1582gitlab # [ 320.606729] setup-gitlab-start[2929]: + systemctl restart gitlab-sidekiq.service1583gitlab # [ 320.643094] systemd[1]: Stopping gitlab-sidekiq.service...1584gitlab # [ 320.646684] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:24.461Z","message":"Shutting down"}1585gitlab # [ 320.650999] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:24.462Z","message":"Scheduler exiting..."}1586gitlab # [ 320.655418] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:24.462Z","message":"Terminating quiet threads for default capsule"}1587gitlab # [ 320.660665] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:24.462Z","message":"Scheduler exiting..."}1588gitlab # [ 321.147113] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:24.966Z","message":"Bye!"}1589gitlab # [ 321.188472] sidekiq-cluster[2016]: {"severity":"INFO","time":"2026-09-09T10:36:25.007Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2016,"worker_id":"sidekiq_0","memwd_rss_bytes":956284928,"retry":0}1590gitlab # [ 322.444496] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1591gitlab # [ 322.444896] systemd[1]: Stopped gitlab-sidekiq.service.1592gitlab # [ 322.445098] systemd[1]: gitlab-sidekiq.service: Consumed 1min 51.435s CPU time over 3min 20.422s wall clock time, 952.1M memory peak, 5.2M read from disk.1593gitlab # [ 322.458433] systemd[1]: Started gitlab-sidekiq.service.1594gitlab # [ 322.461897] setup-gitlab-start[2929]: + mkdir -p /var/lib/secrets1595gitlab # [ 322.467661] setup-gitlab-start[2929]: + echo nixbot-test-token-of-20-chars1596gitlab # [ 322.470693] setup-gitlab-start[2929]: + chmod 644 /var/lib/secrets/gitlab-token1597gitlab # [ 322.473787] setup-gitlab-start[2929]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1598gitlab # [ 323.129015] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:26 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 6091599gitlab # [ 324.388203] gitaly[903]: time="2026-09-09T10:36:28.206Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:38.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.205" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1600gitlab # [ 324.389652] gitaly[903]: time="2026-09-09T10:36:28.208Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:38.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.205" grpc.time_ms=2.933 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1601gitlab # [ 324.685210] gitaly[903]: time="2026-09-09T10:36:28.504Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:38.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.503" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1602gitlab # [ 324.746129] gitaly[903]: time="2026-09-09T10:36:28.504Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:38.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.503" grpc.time_ms=0.778 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1603gitlab # [ 324.772364] gitaly[903]: time="2026-09-09T10:36:28.581Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K diskcache=efb2620b-8353-4753-b040-d126cb6d989e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-09T10:36:38.019" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.520" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1604gitlab # [ 324.792955] gitaly[903]: time="2026-09-09T10:36:28.582Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=33 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=40 command.spawn_token_fork_ms=10 command.system_time_ms=27 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-09T10:36:38.019" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.520" grpc.time_ms=61.831 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1605gitlab # [ 324.813844] gitaly[903]: time="2026-09-09T10:36:28.601Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:38.099" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.600" pid=903 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1606gitlab # [ 324.827983] gitaly[903]: time="2026-09-09T10:36:28.601Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:38.099" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.600" grpc.time_ms=1.221 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1607gitlab # [ 324.843520] gitaly[903]: time="2026-09-09T10:36:28.622Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:36:38.108" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.608" grpc.time_ms=13.438 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1608gitlab # [ 324.902495] gitaly[903]: time="2026-09-09T10:36:28.721Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:38.220" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.721" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1609gitlab # [ 324.923565] gitaly[903]: time="2026-09-09T10:36:28.722Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:38.220" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.721" grpc.time_ms=0.518 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1610gitlab # [ 324.946434] gitaly[903]: time="2026-09-09T10:36:28.765Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K diskcache=5ed727c6-0b11-4fde-be08-98cd52047b59 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-09T10:36:38.224" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.725" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1611gitlab # [ 324.964560] gitaly[903]: time="2026-09-09T10:36:28.766Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1436 command.oublock=32 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-09T10:36:38.224" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.725" grpc.time_ms=40.341 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1612gitlab # [ 324.983755] gitaly[903]: time="2026-09-09T10:36:28.773Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:38.271" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.772" pid=903 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1613gitlab # [ 324.996790] gitaly[903]: time="2026-09-09T10:36:28.773Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:38.271" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.772" grpc.time_ms=1.305 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1614gitlab # [ 325.009209] gitaly[903]: time="2026-09-09T10:36:28.788Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:36:38.277" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.777" grpc.time_ms=10.072 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 325.024682] gitaly[903]: time="2026-09-09T10:36:28.832Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:36:38.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.832" grpc.time_ms=0.32 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1616gitlab # [ 325.036642] gitaly[903]: time="2026-09-09T10:36:28.844Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-09T10:36:38.013" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:28.843" grpc.time_ms=0.595 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1617gitlab # [ 325.642751] gitaly[903]: time="2026-09-09T10:36:29.461Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VV2Z290EEV1JYJ1YQEK3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:36:39.243" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:29.444" grpc.time_ms=17.277 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1618gitlab # [ 326.304525] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:30 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 31441619gitlab # [ 326.308423] setup-gitlab-start[3368]: {"id":1,"message":null,"error":null}1620gitlab # [ 327.536127] sidekiq-cluster[3350]: {"severity":"INFO","time":"2026-09-09T10:36:31.326Z","message":"Starting cluster with 1 processes"}1621gitlab # [ 331.551820] gitaly[903]: time="2026-09-09T10:36:35.370Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVAYXSP9GP2JPF9150GWX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:36:45.152" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:35.352" grpc.time_ms=16.991 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1622gitlab # [ 331.676399] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:35 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 3281623gitlab # [ 331.683116] setup-gitlab-start[2929]: + mkdir -p /tmp/test-flake1624gitlab # [ 331.686391] setup-gitlab-start[2929]: + cd /tmp/test-flake1625gitlab # [ 331.688916] setup-gitlab-start[2929]: + git init -b master1626gitlab # [ 331.715100] setup-gitlab-start[3447]: Initialized empty Git repository in /tmp/test-flake/.git/1627gitlab # [ 331.718823] setup-gitlab-start[2929]: + git config user.name test1628gitlab # [ 331.722512] setup-gitlab-start[2929]: + git config user.email test@example.com1629gitlab # [ 331.729635] setup-gitlab-start[2929]: + cat1630gitlab # [ 331.735262] setup-gitlab-start[2929]: + git add flake.nix1631gitlab # [ 331.744394] setup-gitlab-start[2929]: + git commit -m 'initial commit'1632gitlab # [ 331.774293] setup-gitlab-start[3452]: [master (root-commit) ea14dea] initial commit1633gitlab # [ 331.777569] setup-gitlab-start[3452]: 1 file changed, 10 insertions(+)1634gitlab # [ 331.780293] setup-gitlab-start[3452]: create mode 100644 flake.nix1635gitlab # [ 331.782834] setup-gitlab-start[2929]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1636gitlab # [ 331.788713] setup-gitlab-start[2929]: + git push -u origin master1637gitlab # [ 331.902968] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:35 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 691638gitlab # [ 332.081606] gitaly[903]: time="2026-09-09T10:36:35.900Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBGB40PJMGA5GXNR0PEA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:35.881" grpc.time_ms=18.894 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1639gitlab # [ 332.119744] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:35 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1771640gitlab # [ 332.406217] gitaly[903]: time="2026-09-09T10:36:36.225Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:36:46.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:36.206" grpc.time_ms=18.518 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1641gitlab # [ 332.478605] gitaly[903]: time="2026-09-09T10:36:36.297Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=6 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-09T10:37:06.077" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-09T10:36:36.278" grpc.time_ms=19.096 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1642gitlab # [ 332.517877] gitaly[903]: time="2026-09-09T10:36:36.337Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M22VVBPCMEJCCWP399QMZ4BT duration_ms=230ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/allowed"1643gitlab # [ 332.565984] gitaly[903]: time="2026-09-09T10:36:36.384Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M22VVBPCMEJCCWP399QMZ4BT duration_ms=46ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/pre_receive"1644gitlab # [ 332.579399] gitaly[903]: time="2026-09-09T10:36:36.384Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:36.104" grpc.time_ms=280.106 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1645gitlab # [ 332.617038] gitaly[903]: time="2026-09-09T10:36:36.436Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:36.435" grpc.time_ms=1.192 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1646gitlab # [ 332.655279] gitaly[903]: time="2026-09-09T10:36:36.474Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:36.473" grpc.time_ms=0.926 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1647gitlab # [ 332.714872] gitaly[903]: time="2026-09-09T10:36:36.534Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:36.532" grpc.time_ms=1.55 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1648gitlab # [ 332.891587] gitaly[903]: time="2026-09-09T10:36:36.710Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:36:46.192" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:36.692" grpc.time_ms=17.541 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1649gitlab # [ 332.978457] gitaly[903]: time="2026-09-09T10:36:36.797Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1433 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=4 command.system_time_ms=27 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-09T10:36:46.256" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:36.756" grpc.time_ms=40.317 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1650gitlab # [ 333.017605] gitaly[903]: time="2026-09-09T10:36:36.819Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M22VVBPCMEJCCWP399QMZ4BT duration_ms=227ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/post_receive"1651gitlab # [ 333.025198] gitaly[903]: time="2026-09-09T10:36:36.820Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:36.590" grpc.time_ms=229.979 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1652gitlab # [ 333.049035] gitaly[903]: time="2026-09-09T10:36:36.837Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT diskcache=738b988d-7c29-4ce9-a2be-80df9fa5e450 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:35.998" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1653gitlab # [ 333.069082] systemd[1]: Finished setup-gitlab.service.1654gitlab # [ 333.070999] gitlab-workhorse[820]: time="2026-09-09T10:36:36Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521655gitlab # [ 333.074462] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:36 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 9211656gitlab # [ 333.078217] setup-gitlab-start[3456]: To http://gitlab/root/test-flake.git1657gitlab # [ 333.079748] setup-gitlab-start[3456]: * [new branch] master -> master1658gitlab # [ 333.081321] setup-gitlab-start[3456]: branch 'master' set up to track 'origin/master'.1659gitlab # [ 333.083005] gitaly[903]: time="2026-09-09T10:36:36.837Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=302 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13530 command.oublock=32 command.real_time_ms=829 command.spawn_token_fork_ms=2 command.system_time_ms=192 command.user_time_ms=110 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:35.998" grpc.time_ms=839.046 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1660gitlab # [ 333.102406] systemd[1]: Starting nixbot CI service...1661gitlab: (finished: waiting for unit setup-gitlab.service, in 334.69 seconds)1662gitlab: waiting for unit nixbot.service1663gitlab # [ 334.329866] nixbot[3537]: {"ts": "2026-09-09T10:36:38.148Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1664gitlab # [ 334.368589] nixbot[3537]: {"ts": "2026-09-09T10:36:38.187Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1665gitlab # [ 334.407125] nixbot[3537]: {"ts": "2026-09-09T10:36:38.226Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1666gitlab # [ 334.413877] nixbot[3537]: {"ts": "2026-09-09T10:36:38.233Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1667gitlab # [ 334.420524] nixbot[3537]: {"ts": "2026-09-09T10:36:38.238Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1668gitlab # [ 334.428395] nixbot[3537]: {"ts": "2026-09-09T10:36:38.247Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1669gitlab # [ 334.434900] nixbot[3537]: {"ts": "2026-09-09T10:36:38.253Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1670gitlab # [ 334.441383] nixbot[3537]: {"ts": "2026-09-09T10:36:38.255Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1671gitlab # [ 334.447870] nixbot[3537]: {"ts": "2026-09-09T10:36:38.264Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1672gitlab # [ 334.454368] nixbot[3537]: {"ts": "2026-09-09T10:36:38.267Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1673gitlab # [ 334.461230] nixbot[3537]: {"ts": "2026-09-09T10:36:38.274Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1674gitlab # [ 334.467535] nixbot[3537]: {"ts": "2026-09-09T10:36:38.283Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1675gitlab # [ 334.474168] nixbot[3537]: {"ts": "2026-09-09T10:36:38.289Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1676gitlab # [ 334.481833] nixbot[3537]: {"ts": "2026-09-09T10:36:38.292Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1677gitlab # [ 334.488695] nixbot[3537]: {"ts": "2026-09-09T10:36:38.299Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1678gitlab # [ 334.494721] nixbot[3537]: {"ts": "2026-09-09T10:36:38.303Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1679gitlab # [ 334.500242] nixbot[3537]: {"ts": "2026-09-09T10:36:38.306Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1680gitlab # [ 334.505810] nixbot[3537]: {"ts": "2026-09-09T10:36:38.309Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1681gitlab # [ 334.511038] nixbot[3537]: {"ts": "2026-09-09T10:36:38.317Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1682gitlab # [ 334.516104] nixbot[3537]: {"ts": "2026-09-09T10:36:38.320Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1683gitlab # [ 334.521208] nixbot[3537]: {"ts": "2026-09-09T10:36:38.322Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1684gitlab # [ 334.526238] nixbot[3537]: {"ts": "2026-09-09T10:36:38.332Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1685gitlab # [ 334.531481] nixbot[3537]: {"ts": "2026-09-09T10:36:38.334Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1686gitlab # [ 334.536207] nixbot[3537]: {"ts": "2026-09-09T10:36:38.337Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1687gitlab # [ 334.540566] nixbot[3537]: {"ts": "2026-09-09T10:36:38.339Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1688gitlab # [ 334.544745] nixbot[3537]: {"ts": "2026-09-09T10:36:38.342Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1689gitlab # [ 334.548744] nixbot[3537]: {"ts": "2026-09-09T10:36:38.345Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1690gitlab # [ 334.552577] nixbot[3537]: {"ts": "2026-09-09T10:36:38.347Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1691gitlab # [ 334.556276] nixbot[3537]: {"ts": "2026-09-09T10:36:38.349Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1692gitlab # [ 334.561125] nixbot[3537]: {"ts": "2026-09-09T10:36:38.368Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1693gitlab # [ 334.564894] nixbot[3537]: {"ts": "2026-09-09T10:36:38.376Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1694gitlab # [ 334.568646] nixbot[3537]: {"ts": "2026-09-09T10:36:38.382Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1695gitlab # [ 334.572519] nixbot[3537]: {"ts": "2026-09-09T10:36:38.385Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1696gitlab # [ 334.576292] nixbot[3537]: {"ts": "2026-09-09T10:36:38.391Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1697gitlab # [ 334.990004] nixbot[3537]: INFO: Started server process [3537]1698gitlab # [ 334.991171] nixbot[3537]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1699gitlab # [ 335.025280] nixbot[3537]: INFO: ::ffff:127.0.0.1:43314 - "GET /health HTTP/1.1" 200 OK1700gitlab # [ 335.033352] systemd[1]: Started nixbot CI service.1701gitlab # [ 335.036930] systemd[1]: Reached target Multi-User System.1702gitlab # [ 335.037794] systemd[1]: Startup finished in 840ms (kernel) + 4.137s (initrd) + 5min 30.059s (userspace) = 5min 35.037s.1703gitlab: (finished: waiting for unit nixbot.service, in 1.11 seconds)1704gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1705gitlab # [ 335.391821] nixbot[3537]: INFO: ::ffff:127.0.0.1:43330 - "GET /health HTTP/1.1" 200 OK1706gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds)1707subtest: project discovered and webhook registered1708gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1709gitlab # [ 335.613279] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:39 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 5871710gitlab # [ 335.616216] nixbot[3537]: {"ts": "2026-09-09T10:36:39.433Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1711gitlab # [ 335.689873] nixbot[3537]: {"ts": "2026-09-09T10:36:39.508Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1712gitlab # [ 335.865833] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1501713gitlab # [ 335.869891] nixbot[3537]: {"ts": "2026-09-09T10:36:39.688Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1714gitlab # [ 335.878146] nixbot[3537]: {"ts": "2026-09-09T10:36:39.696Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1715gitlab # [ 336.111565] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 2221716gitlab # [ 336.113907] nixbot[3537]: {"ts": "2026-09-09T10:36:39.932Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1717gitlab # [ 336.287525] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 8301718gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.89 seconds)1719(finished: subtest: project discovered and webhook registered, in 0.89 seconds)1720subtest: push delivers the webhook1721gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1722gitlab # [ 336.373914] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:40 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2401723gitlab # [ 336.376424] nixbot[3537]: {"ts": "2026-09-09T10:36:40.194Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1724gitlab # [ 336.445819] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 571725gitlab # [ 336.448421] nixbot[3537]: {"ts": "2026-09-09T10:36:40.266Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1726gitlab # [ 336.524478] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:40 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 651727gitlab # [ 336.534945] nixbot[3537]: {"ts": "2026-09-09T10:36:40.342Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1728gitlab # [ 336.699691] gitaly[903]: time="2026-09-09T10:36:40.517Z" level=info msg="finished unary call with code OK" catfile.duration_ms=7 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=7 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVG19KZ7X6KT7095864P9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-09T10:37:10.091" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:40.492" grpc.time_ms=25.24 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1729gitlab # [ 336.859668] gitaly[903]: time="2026-09-09T10:36:40.678Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVG19KZ7X6KT7095864P9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:37:10.276" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:40.676" grpc.time_ms=1.804 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1730gitlab # [ 336.886489] gitaly[903]: time="2026-09-09T10:36:40.705Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVG19KZ7X6KT7095864P9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-09T10:36:50.009" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:40.691" grpc.time_ms=14.426 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1731gitlab # [ 337.069815] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 5261732gitlab # [ 337.076947] nixbot[3537]: {"ts": "2026-09-09T10:36:40.889Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1733gitlab # [ 337.198429] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1241734gitlab # [ 337.206058] nixbot[3537]: {"ts": "2026-09-09T10:36:41.019Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1735gitlab # [ 337.214219] nixbot[3537]: {"ts": "2026-09-09T10:36:41.026Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1736gitlab # [ 337.403041] gitaly[903]: time="2026-09-09T10:36:41.222Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=7 command.system_time_ms=11 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M22VVGQR04ZXB35ZX9HKP1H9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:41.200" grpc.time_ms=21.896 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1737gitlab # [ 337.429784] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1431738gitlab # [ 337.610127] gitaly[903]: time="2026-09-09T10:36:41.429Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVGWBC7DMRY7T90NNNZHG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:41.413" pid=903 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1739gitlab # [ 337.623713] gitaly[903]: time="2026-09-09T10:36:41.429Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVGWBC7DMRY7T90NNNZHG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:41.413" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1740gitlab # [ 337.640459] gitaly[903]: time="2026-09-09T10:36:41.430Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVGWBC7DMRY7T90NNNZHG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:41.413" grpc.time_ms=15.957 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1741gitlab # [ 337.656393] gitlab-workhorse[820]: time="2026-09-09T10:36:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131742gitlab # [ 337.658287] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 2151743gitlab # [ 337.788855] gitaly[903]: time="2026-09-09T10:36:41.606Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVH3A4R72GVSX6T3H2538 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:41.572" pid=903 remote_ip="2001:db8:1::1" request_sha=d02f815367c827d8ef5a1fabeea047738f24c12f response_bytes=223 span.kind=server system=grpc1744gitlab # [ 337.820442] gitaly[903]: time="2026-09-09T10:36:41.607Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1138 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=17 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVH3A4R72GVSX6T3H2538 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:41.572" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1745gitlab # [ 337.852473] gitlab-workhorse[820]: time="2026-09-09T10:36:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231746gitlab # [ 337.855785] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1571747gitlab # [ 337.860815] gitaly[903]: time="2026-09-09T10:36:41.607Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1138 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=17 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVH3A4R72GVSX6T3H2538 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:41.572" grpc.time_ms=34.829 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1748gitlab # [ 337.977324] gitaly[903]: time="2026-09-09T10:36:41.796Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVHAB9CBFBGT4118XH4KJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:41.780" grpc.time_ms=15.653 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1749gitlab # [ 338.017854] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1611750gitlab # [ 338.159159] gitaly[903]: time="2026-09-09T10:36:41.978Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVHFF3A7PQGPKEBNWTAZX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:41.959" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1751gitlab # [ 338.177449] gitaly[903]: time="2026-09-09T10:36:41.978Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVHFF3A7PQGPKEBNWTAZX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:41.959" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1752gitlab # [ 338.198675] gitlab-workhorse[820]: time="2026-09-09T10:36:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671753gitlab # [ 338.201348] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1401754gitlab # [ 338.203884] gitaly[903]: time="2026-09-09T10:36:41.979Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVHFF3A7PQGPKEBNWTAZX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:41.959" grpc.time_ms=19.592 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1755gitlab # [ 338.339576] gitaly[903]: time="2026-09-09T10:36:42.158Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22VVHPBXN2ERFXPMEM0NXV6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:42.140" grpc.time_ms=17.918 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1756gitlab # [ 338.361426] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:42 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1011757gitlab # [ 338.510558] gitaly[903]: time="2026-09-09T10:36:42.329Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVHSNA22A29GR8EEFEJS2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:42.302" pid=903 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1758gitlab # [ 338.544889] gitaly[903]: time="2026-09-09T10:36:42.330Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=4 command.system_time_ms=18 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVHSNA22A29GR8EEFEJS2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:42.302" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1759gitlab # [ 338.582507] gitlab-workhorse[820]: time="2026-09-09T10:36:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091760gitlab # [ 338.587486] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1661761gitlab # [ 338.592255] gitaly[903]: time="2026-09-09T10:36:42.330Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=4 command.system_time_ms=18 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVHSNA22A29GR8EEFEJS2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:42.302" grpc.time_ms=28.141 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1762gitlab # [ 338.679637] gitaly[903]: time="2026-09-09T10:36:42.498Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:37:12.296" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:42.497" grpc.time_ms=1.063 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab # [ 338.737180] gitaly[903]: time="2026-09-09T10:36:42.556Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-09T10:37:12.343" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:42.543" grpc.time_ms=12.452 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 338.784442] gitaly[903]: time="2026-09-09T10:36:42.603Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:36:52.085" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:42.586" grpc.time_ms=16.461 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 338.819642] gitaly[903]: time="2026-09-09T10:36:42.638Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:36:52.120" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:42.620" grpc.time_ms=17.115 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 339.098261] gitaly[903]: time="2026-09-09T10:36:42.917Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-09T10:36:52.085" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:42.916" grpc.time_ms=0.557 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 339.132565] gitaly[903]: time="2026-09-09T10:36:42.951Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-09T10:36:52.102" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:42.933" grpc.time_ms=17.907 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 339.206029] gitaly[903]: time="2026-09-09T10:36:43.025Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:43.024" grpc.time_ms=0.704 pid=903 span.kind=server system=grpc1769gitlab # [ 339.245188] gitaly[903]: time="2026-09-09T10:36:43.064Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:36:43.063" grpc.time_ms=0.913 pid=903 span.kind=server system=grpc1770gitlab # [ 339.273745] gitaly[903]: time="2026-09-09T10:36:43.076Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 diskcache=f1192bc7-8c90-4fbd-8c74-a6c7b14002c3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-09T10:36:52.125" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:42.956" pid=903 ref=refs/keep-around/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 remote_ip="2001:db8:1::1" revision=ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 span.kind=server system=grpc username=root1771gitlab # [ 339.297176] gitaly[903]: time="2026-09-09T10:36:43.077Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=106 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5048 command.oublock=8 command.real_time_ms=110 command.spawn_token_fork_ms=6 command.system_time_ms=65 command.user_time_ms=41 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-09T10:36:52.125" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:36:42.956" grpc.time_ms=120.391 pid=903 ref=refs/keep-around/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 remote_ip="2001:db8:1::1" revision=ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 span.kind=server system=grpc username=root1772gitlab # [ 339.319210] gitaly[903]: time="2026-09-09T10:36:43.081Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:37:13.080" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:43.081" grpc.time_ms=0.51 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 339.504201] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 9221774gitlab # [ 339.513607] nixbot[3537]: {"ts": "2026-09-09T10:36:43.323Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 \"HTTP/1.1 201 Created\""}1775gitlab # [ 339.523955] nixbot[3537]: {"ts": "2026-09-09T10:36:43.333Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-ea14dead7063-0"}1776gitlab # [ 339.806024] nixbot[3537]: {"ts": "2026-09-09T10:36:43.625Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-ea14dead7063-0", "argv0": "bwrap"}1777gitlab # [ 339.966618] systemd[1]: Started Nix Daemon.1778gitlab # [ 340.087300] nix-daemon[3707]: accepted connection from pid 3702, user nixbot1779gitlab # [ 344.819866] nix-daemon[3707]: accepted connection from pid 3750, user nixbot1780gitlab # [ 344.841250] nix-daemon[3707]: accepted connection from pid 3702, user nixbot1781gitlab # [ 349.709294] nix-daemon[3707]: accepted connection from pid 3702, user nixbot1782gitlab # [ 349.933771] gitaly[903]: time="2026-09-09T10:36:53.751Z" level=info msg="finished unary call with code OK" catfile.duration_ms=7 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=7 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVWZQGNSH0KWAEPFW074Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:37:23.541" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:53.742" grpc.time_ms=9.686 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1783gitlab # [ 350.052332] gitaly[903]: time="2026-09-09T10:36:53.871Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22VVWZQGNSH0KWAEPFW074Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:37:03.022" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:53.853" grpc.time_ms=18.182 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1784gitlab # [ 350.171142] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:53 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3651785gitlab # [ 350.178856] nixbot[3537]: {"ts": "2026-09-09T10:36:53.991Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 \"HTTP/1.1 201 Created\""}1786gitlab # [ 350.276472] gitaly[903]: time="2026-09-09T10:36:54.095Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVXBDVWXH2GB0MBNTN1RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:37:24.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:54.094" grpc.time_ms=1.102 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787gitlab # [ 350.346641] gitaly[903]: time="2026-09-09T10:36:54.165Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M22VVXBDVWXH2GB0MBNTN1RV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:37:04.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:54.148" grpc.time_ms=17.436 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788gitlab # [ 350.491130] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3121789gitlab # [ 350.497429] nixbot[3537]: {"ts": "2026-09-09T10:36:54.312Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 \"HTTP/1.1 201 Created\""}1790gitlab # [ 350.597036] gitaly[903]: time="2026-09-09T10:36:54.416Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVXNYCXH0SYJYXBV1Z360 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:37:24.214" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:36:54.414" grpc.time_ms=1.041 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 350.667678] gitaly[903]: time="2026-09-09T10:36:54.486Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22VVXNYCXH0SYJYXBV1Z360 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:37:04.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:36:54.470" grpc.time_ms=15.949 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 350.758138] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2431793gitlab # [ 350.762180] nixbot[3537]: {"ts": "2026-09-09T10:36:54.578Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 \"HTTP/1.1 201 Created\""}1794gitlab # [ 351.315706] gitaly[903]: time="2026-09-09T10:36:55.134Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22VVYBR227BFGKYWEFW4XX2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:55.116" grpc.time_ms=17.728 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1795gitlab # [ 351.339117] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:55 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1021796gitlab # [ 351.447573] gitaly[903]: time="2026-09-09T10:36:55.266Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVYF1N1TDYF8YPMP0VGE9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:55.248" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1797gitlab # [ 351.478379] gitaly[903]: time="2026-09-09T10:36:55.266Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVYF1N1TDYF8YPMP0VGE9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:55.248" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1798gitlab # [ 351.506478] gitlab-workhorse[820]: time="2026-09-09T10:36:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671799gitlab # [ 351.509694] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1301800gitlab # [ 351.512773] gitaly[903]: time="2026-09-09T10:36:55.267Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVYF1N1TDYF8YPMP0VGE9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:55.248" grpc.time_ms=18.355 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1801gitlab # [ 351.598130] gitaly[903]: time="2026-09-09T10:36:55.417Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVYMYV9VTNSA9ZZ2AKPWK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:55.402" grpc.time_ms=14.259 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1802gitlab # [ 351.632350] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:55 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 911803gitlab # [ 351.672702] gitaly[903]: time="2026-09-09T10:36:55.491Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVYQVEZXX17MSW9MA657A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:55.479" pid=903 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1804gitlab # [ 351.693442] gitaly[903]: time="2026-09-09T10:36:55.492Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVYQVEZXX17MSW9MA657A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:55.479" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1805gitlab # [ 351.716637] gitlab-workhorse[820]: time="2026-09-09T10:36:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671806gitlab # [ 351.719299] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:36:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 731807gitlab # [ 351.722147] gitaly[903]: time="2026-09-09T10:36:55.492Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVYQVEZXX17MSW9MA657A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:36:55.479" grpc.time_ms=12.569 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1808gitlab # [ 367.438167] sidekiq-cluster[3419]: 2026-09-09T10:37:11.256Z pid=3419 tid=yr7 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3419, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430731264}1809gitlab # [ 367.711243] sidekiq-cluster[3419]: W, [2026-09-09T10:37:11.530355 #3419] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1810gitlab # [ 367.774307] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:37:11.593Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1811gitlab # [ 371.322191] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:37:15.140Z","message":"GitLab reliable fetch activated!"}1812gitlab # [ 371.322554] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:37:15.140Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1813gitlab # [ 408.971113] postgres[4268]: [4268] ERROR: relation "table_without_models" does not exist1814gitlab # [ 408.971717] postgres[4268]: [4268] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1815gitlab # [ 413.797429] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:37:57.615Z","message":"Booted Rails 7.2.3.1 application in production environment"}1816gitlab # [ 413.804189] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:37:57.623Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1817gitlab # [ 413.810535] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:37:57.623Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1818gitlab # [ 413.816062] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:37:57.623Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1819gitlab # [ 413.822265] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:37:57.625Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1820gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 78.53 seconds)1821gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1822gitlab # [ 415.115411] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:37:58 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 2051823gitlab # [ 415.362052] gitaly[903]: time="2026-09-09T10:37:59.180Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VXWRQVHFQT1WPQR3ZN6A8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:37:59.160" grpc.time_ms=18.982 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1824gitlab # Enumerating objects: 5, done.1825gitlab # [ 415.402053] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:37:59 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 200 "" "git/2.55.0" 2451826gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1827gitlab # Delta compression using up to 4 threads1828gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1829gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 91.00 KiB/s, done.1830gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1831gitlab # [ 415.823700] gitaly[903]: time="2026-09-09T10:37:59.642Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-09T10:38:29.430" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-09T10:37:59.631" grpc.time_ms=11.197 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1832gitlab # [ 415.866171] gitaly[903]: time="2026-09-09T10:37:59.675Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH duration_ms=179ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/allowed"1833gitlab # [ 415.916179] gitaly[903]: time="2026-09-09T10:37:59.734Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH duration_ms=58ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/pre_receive"1834gitlab # [ 415.925917] gitaly[903]: time="2026-09-09T10:37:59.744Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:37:59.492" grpc.time_ms=242.396 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1835gitlab # [ 415.975274] gitaly[903]: time="2026-09-09T10:37:59.794Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:37:59.793" grpc.time_ms=1.146 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1836gitlab # [ 416.013376] gitaly[903]: time="2026-09-09T10:37:59.832Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:37:59.831" grpc.time_ms=0.837 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1837gitlab # [ 416.041380] gitaly[903]: time="2026-09-09T10:37:59.859Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:37:59.859" grpc.time_ms=0.495 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1838gitlab # [ 416.173575] gitaly[903]: time="2026-09-09T10:37:59.992Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH duration_ms=100ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/post_receive"1839gitlab # [ 416.182913] gitaly[903]: time="2026-09-09T10:37:59.993Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:37:59.891" grpc.time_ms=101.91 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1840gitlab # To http://gitlab/root/test-flake.git1841gitlab # [ 416.213400] gitaly[903]: time="2026-09-09T10:38:00.004Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH diskcache=e5721b34-b198-40de-9791-2aaccb5bead9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:37:59.382" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1842gitlab # ea14dea..f5b5ea6 master -> master1843gitlab # [ 416.236405] gitlab-workhorse[820]: time="2026-09-09T10:38:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521844gitlab # [ 416.239823] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:00 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7601845gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.43 seconds)1846gitlab: must succeed: git -C /tmp/test-flake rev-parse master1847gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1848gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5'1849gitlab # [ 416.243439] gitaly[903]: time="2026-09-09T10:38:00.004Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=272 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13470 command.oublock=32 command.real_time_ms=613 command.spawn_token_fork_ms=2 command.system_time_ms=180 command.user_time_ms=92 component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:37:59.382" grpc.time_ms=622.173 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1850gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', in 0.08 seconds)1851gitlab # [ 416.339396] nixbot[3537]: INFO: ::ffff:127.0.0.1:49050 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 HTTP/1.1" 200 OK1852gitlab # [ 416.461022] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:00.278Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b05f89847f1e0b649da3d0bf","created_at":"2026-09-09T10:36:28.640Z","trace_propagation_headers":{"sentry-trace":"0ffcd40dc936427e94bc6df72626297d-c0582847ff8b4202","baggage":"sentry-trace_id=0ffcd40dc936427e94bc6df72626297d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VV2Z290EEV1JYJ1YQEK3K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:28.690Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b05f89847f1e0b649da3d0bf: start","job_status":"start","queue_duration_s":91.588449,"scheduling_latency_s":91.588503}1853gitlab # [ 416.720327] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:00.538Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b05f89847f1e0b649da3d0bf","created_at":"2026-09-09T10:36:28.640Z","trace_propagation_headers":{"sentry-trace":"0ffcd40dc936427e94bc6df72626297d-c0582847ff8b4202","baggage":"sentry-trace_id=0ffcd40dc936427e94bc6df72626297d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VV2Z290EEV1JYJ1YQEK3K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:28.690Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b05f89847f1e0b649da3d0bf: done: 0.259897 sec","job_status":"done","queue_duration_s":91.588449,"scheduling_latency_s":91.588503,"redis_calls":23,"redis_duration_s":0.007549,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.003758,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002163,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001628,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14628166,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.259897,"completed_at":"2026-09-09T10:38:00.538Z","load_balancing_strategy":"primary","db_duration_s":0.097692,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1854gitlab # [ 416.831854] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:00.541Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e1afd21925fd3ca757a170b1","created_at":"2026-09-09T10:36:28.707Z","trace_propagation_headers":{"sentry-trace":"0ffcd40dc936427e94bc6df72626297d-c0582847ff8b4202","baggage":"sentry-trace_id=0ffcd40dc936427e94bc6df72626297d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VV2Z290EEV1JYJ1YQEK3K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:28.715Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e1afd21925fd3ca757a170b1: start","job_status":"start","queue_duration_s":91.82596,"scheduling_latency_s":91.82599}1855gitlab # [ 416.886534] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:00.705Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e1afd21925fd3ca757a170b1","created_at":"2026-09-09T10:36:28.707Z","trace_propagation_headers":{"sentry-trace":"0ffcd40dc936427e94bc6df72626297d-c0582847ff8b4202","baggage":"sentry-trace_id=0ffcd40dc936427e94bc6df72626297d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VV2Z290EEV1JYJ1YQEK3K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:28.715Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e1afd21925fd3ca757a170b1: done: 0.163873 sec","job_status":"done","queue_duration_s":91.82596,"scheduling_latency_s":91.82599,"redis_calls":14,"redis_duration_s":0.005394,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000791,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003029,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001574,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12477828,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.163873,"completed_at":"2026-09-09T10:38:00.704Z","load_balancing_strategy":"primary","db_duration_s":0.035497,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1856gitlab # [ 416.951216] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:00.707Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"5ebc61019d5ff99c3ca04071","created_at":"2026-09-09T10:36:29.330Z","trace_propagation_headers":{"sentry-trace":"0ffcd40dc936427e94bc6df72626297d-c0582847ff8b4202","baggage":"sentry-trace_id=0ffcd40dc936427e94bc6df72626297d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VV2Z290EEV1JYJ1YQEK3K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:29.337Z","job_size_bytes":5,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-5ebc61019d5ff99c3ca04071: start","job_status":"start","queue_duration_s":91.369867,"scheduling_latency_s":91.370028}1857gitlab # [ 417.127179] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:00.945Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"5ebc61019d5ff99c3ca04071","created_at":"2026-09-09T10:36:29.330Z","trace_propagation_headers":{"sentry-trace":"0ffcd40dc936427e94bc6df72626297d-c0582847ff8b4202","baggage":"sentry-trace_id=0ffcd40dc936427e94bc6df72626297d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VV2Z290EEV1JYJ1YQEK3K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:29.337Z","job_size_bytes":5,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-5ebc61019d5ff99c3ca04071: done: 0.238276 sec","job_status":"done","queue_duration_s":91.369867,"scheduling_latency_s":91.370028,"redis_calls":12,"redis_duration_s":0.0033900000000000002,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000859,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002004,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000527,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.188645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034388,"duration_s":0.238276,"completed_at":"2026-09-09T10:38:00.945Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04145,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1858gitlab # [ 417.234141] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:00.947Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"c4c3e40c234df68626b1216c","created_at":"2026-09-09T10:36:29.372Z","trace_propagation_headers":{"sentry-trace":"0ffcd40dc936427e94bc6df72626297d-c0582847ff8b4202","baggage":"sentry-trace_id=0ffcd40dc936427e94bc6df72626297d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VV2Z290EEV1JYJ1YQEK3K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:29.377Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-c4c3e40c234df68626b1216c: start","job_status":"start","queue_duration_s":91.5705,"scheduling_latency_s":91.570519}1859gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5'1860gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', in 0.06 seconds)1861gitlab # [ 417.402658] nixbot[3537]: INFO: ::ffff:127.0.0.1:49058 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 HTTP/1.1" 200 OK1862gitlab # [ 417.482888] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:01.299Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"c4c3e40c234df68626b1216c","created_at":"2026-09-09T10:36:29.372Z","trace_propagation_headers":{"sentry-trace":"0ffcd40dc936427e94bc6df72626297d-c0582847ff8b4202","baggage":"sentry-trace_id=0ffcd40dc936427e94bc6df72626297d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VV2Z290EEV1JYJ1YQEK3K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:29.377Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-c4c3e40c234df68626b1216c: done: 0.35206 sec","job_status":"done","queue_duration_s":91.5705,"scheduling_latency_s":91.570519,"redis_calls":11,"redis_duration_s":0.003919,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00084,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002291,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000788,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.299,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.299,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.242573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00101804,"duration_s":0.35206,"completed_at":"2026-09-09T10:38:01.299Z","load_balancing_strategy":"primary","db_duration_s":0.112202,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1863gitlab # [ 417.575621] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:01.303Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0fefa09b291f4d8ba8b5257a","created_at":"2026-09-09T10:36:29.380Z","trace_propagation_headers":{"sentry-trace":"0ffcd40dc936427e94bc6df72626297d-c0582847ff8b4202","baggage":"sentry-trace_id=0ffcd40dc936427e94bc6df72626297d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VV2Z290EEV1JYJ1YQEK3K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:29.385Z","job_size_bytes":89,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0fefa09b291f4d8ba8b5257a: start","job_status":"start","queue_duration_s":91.91769,"scheduling_latency_s":91.917731}1864gitlab # [ 417.595982] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:01.393Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0fefa09b291f4d8ba8b5257a","created_at":"2026-09-09T10:36:29.380Z","trace_propagation_headers":{"sentry-trace":"0ffcd40dc936427e94bc6df72626297d-c0582847ff8b4202","baggage":"sentry-trace_id=0ffcd40dc936427e94bc6df72626297d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VV2Z290EEV1JYJ1YQEK3K","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:29.385Z","job_size_bytes":89,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0fefa09b291f4d8ba8b5257a: done: 0.090439 sec","job_status":"done","queue_duration_s":91.91769,"scheduling_latency_s":91.917731,"redis_calls":11,"redis_duration_s":0.0055580000000000004,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001522,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003056,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00090396,"duration_s":0.090439,"completed_at":"2026-09-09T10:38:01.393Z","load_balancing_strategy":"primary","db_duration_s":0.009934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1865gitlab # [ 417.647908] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:01.396Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6e241c5631e9b54d38ed26a5","created_at":"2026-09-09T10:36:36.651Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-76ebb253642a469a","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:36.665Z","job_size_bytes":185,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6e241c5631e9b54d38ed26a5: start","job_status":"start","queue_duration_s":84.731857,"scheduling_latency_s":84.731893}1866gitlab # [ 417.665633] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:01.429Z","message":"changes: \"0000000000000000000000000000000000000000 ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 refs/heads/master\\n\""}1867gitlab # [ 417.677677] gitaly[903]: time="2026-09-09T10:38:01.496Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:11.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:01.479" grpc.time_ms=17.066 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1868gitlab # [ 417.701681] gitaly[903]: time="2026-09-09T10:38:01.520Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:38:11.034" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:38:01.505" grpc.time_ms=15.143 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1869gitlab # [ 417.795286] gitaly[903]: time="2026-09-09T10:38:01.614Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-09T10:38:11.123" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:01.593" grpc.time_ms=20.444 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1870gitlab # [ 417.873454] gitaly[903]: time="2026-09-09T10:38:01.692Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:01.691" grpc.time_ms=0.719 pid=903 span.kind=server system=grpc1871gitlab # [ 417.943060] gitaly[903]: time="2026-09-09T10:38:01.762Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:01.761" grpc.time_ms=0.77 pid=903 span.kind=server system=grpc1872gitlab # [ 417.971729] gitaly[903]: time="2026-09-09T10:38:01.775Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT diskcache=685e66da-68a6-4c1c-a097-edc345ddbd51 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-09T10:38:11.162" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:38:01.633" pid=903 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1873gitlab # [ 417.993987] gitaly[903]: time="2026-09-09T10:38:01.776Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=141 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5125 command.oublock=8 command.real_time_ms=135 command.spawn_token_fork_ms=1 command.system_time_ms=93 command.user_time_ms=48 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-09T10:38:11.162" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:38:01.633" grpc.time_ms=142.496 pid=903 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1874gitlab # [ 418.015718] gitaly[903]: time="2026-09-09T10:38:01.811Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-09T10:38:11.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:38:01.811" grpc.time_ms=0.342 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1875gitlab # [ 418.029812] gitaly[903]: time="2026-09-09T10:38:01.845Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=860 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-09T10:38:11.019" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:01.820" grpc.time_ms=24.852 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876gitlab # [ 418.213190] gitaly[903]: time="2026-09-09T10:38:02.032Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-09T10:38:32.019" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:02.020" grpc.time_ms=11.956 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab # [ 418.276079] gitaly[903]: time="2026-09-09T10:38:02.095Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-09T10:38:12.004" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:38:02.094" grpc.time_ms=0.546 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878gitlab # [ 418.304796] gitaly[903]: time="2026-09-09T10:38:02.111Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-09T10:38:12.009" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-09T10:38:02.100" grpc.time_ms=10.906 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1879gitlab # [ 418.336734] gitaly[903]: time="2026-09-09T10:38:02.155Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:12.048" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:02.139" grpc.time_ms=16.711 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1880gitlab # [ 418.367173] gitaly[903]: time="2026-09-09T10:38:02.186Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:12.079" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:02.169" grpc.time_ms=16.319 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1881gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5'1882gitlab # [ 418.417855] gitaly[903]: time="2026-09-09T10:38:02.237Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-09T10:38:32.208" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:02.209" grpc.time_ms=27.59 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1883gitlab # [ 418.467424] nixbot[3537]: INFO: ::ffff:127.0.0.1:49074 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 HTTP/1.1" 200 OK1884gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', in 0.06 seconds)1885gitlab # [ 419.070424] gitaly[903]: time="2026-09-09T10:38:02.888Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-09T10:38:12.085" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:02.886" grpc.time_ms=2.344 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1886gitlab # [ 419.110979] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:02.928Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6e241c5631e9b54d38ed26a5","created_at":"2026-09-09T10:36:36.651Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-76ebb253642a469a","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:36:36.665Z","job_size_bytes":185,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6e241c5631e9b54d38ed26a5: done: 1.531814 sec","job_status":"done","queue_duration_s":84.731857,"scheduling_latency_s":84.731893,"gitaly_calls":13,"gitaly_duration_s":0.371388,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.069598,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.007391,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009265,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.003025,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005889,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.030015,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.014013,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.088,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.291,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.341,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.088,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.015268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0012548,"exclusive_lock_hold_duration_s":0.04722394,"duration_s":1.531814,"completed_at":"2026-09-09T10:38:02.928Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.152946,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1887gitlab # [ 419.202584] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:02.930Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"f72279a2c730be608855c3c5","created_at":"2026-09-09T10:36:43.088Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-97622390bbec485f","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:43.098Z","job_size_bytes":65,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-f72279a2c730be608855c3c5: start","job_status":"start","queue_duration_s":79.832074,"scheduling_latency_s":79.832097}1888gitlab # [ 419.220907] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:03.035Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"f72279a2c730be608855c3c5","created_at":"2026-09-09T10:36:43.088Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-97622390bbec485f","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:43.098Z","job_size_bytes":65,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-f72279a2c730be608855c3c5: done: 0.104519 sec","job_status":"done","queue_duration_s":79.832074,"scheduling_latency_s":79.832097,"redis_calls":16,"redis_duration_s":0.004752,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.00255,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001617,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000585,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039758,"duration_s":0.104519,"completed_at":"2026-09-09T10:38:03.035Z","load_balancing_strategy":"primary","db_duration_s":0.032667,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1889gitlab # [ 419.264900] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:03.036Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ec665b3637b4f9202ce30139","created_at":"2026-09-09T10:36:43.099Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-97622390bbec485f","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:43.108Z","job_size_bytes":65,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ec665b3637b4f9202ce30139: start","job_status":"start","queue_duration_s":79.928641,"scheduling_latency_s":79.92866}1890gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5'1891gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', in 0.04 seconds)1892gitlab # [ 419.478004] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:03.296Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ec665b3637b4f9202ce30139","created_at":"2026-09-09T10:36:43.099Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-97622390bbec485f","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:43.108Z","job_size_bytes":65,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ec665b3637b4f9202ce30139: done: 0.259947 sec","job_status":"done","queue_duration_s":79.928641,"scheduling_latency_s":79.92866,"redis_calls":21,"redis_duration_s":0.0061519999999999995,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002877,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001674,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001601,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.199831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045004,"duration_s":0.259947,"completed_at":"2026-09-09T10:38:03.296Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.049682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1893gitlab # [ 419.583994] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:03.298Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9c37b49486c6303e3fa5dcce","created_at":"2026-09-09T10:36:43.285Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-97622390bbec485f","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:43.294Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9c37b49486c6303e3fa5dcce: start","job_status":"start","queue_duration_s":80.004179,"scheduling_latency_s":80.004197}1894gitlab # [ 419.604413] nixbot[3537]: INFO: ::ffff:127.0.0.1:49084 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 HTTP/1.1" 200 OK1895gitlab # [ 419.833674] gitaly[903]: time="2026-09-09T10:38:03.652Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:03.651" grpc.time_ms=0.786 pid=903 span.kind=server system=grpc1896gitlab # [ 419.887931] gitaly[903]: time="2026-09-09T10:38:03.707Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:03.706" grpc.time_ms=0.786 pid=903 span.kind=server system=grpc1897gitlab # [ 419.940451] gitaly[903]: time="2026-09-09T10:38:03.759Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:03.758" grpc.time_ms=0.819 pid=903 span.kind=server system=grpc1898gitlab # [ 419.969070] gitaly[903]: time="2026-09-09T10:38:03.771Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 diskcache=3d737720-071d-4a6f-afdb-b1f66c154eb5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:38:33.592" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:03.593" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1899gitlab # [ 419.989459] gitaly[903]: time="2026-09-09T10:38:03.772Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=203 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7544 command.oublock=0 command.real_time_ms=171 command.spawn_token_fork_ms=1 command.system_time_ms=98 command.user_time_ms=105 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:38:33.592" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:03.593" grpc.time_ms=178.581 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1900gitlab # [ 420.153269] gitaly[903]: time="2026-09-09T10:38:03.971Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-09T10:38:33.069" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:03.969" grpc.time_ms=1.419 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1901gitlab # [ 420.209854] gitaly[903]: time="2026-09-09T10:38:04.029Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVJ0YBAE757HVSCQBJB16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:34.027" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:04.027" grpc.time_ms=1.21 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1902gitlab # [ 420.245959] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:04.055Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9c37b49486c6303e3fa5dcce","created_at":"2026-09-09T10:36:43.285Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-97622390bbec485f","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:36:43.294Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9c37b49486c6303e3fa5dcce: done: 0.75654 sec","job_status":"done","queue_duration_s":80.004179,"scheduling_latency_s":80.004197,"gitaly_calls":3,"gitaly_duration_s":0.192121,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.043219,"redis_read_bytes":455,"redis_write_bytes":27995,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002457,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001951,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.013958,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.00614,"redis_queues_read_bytes":34,"redis_queues_write_bytes":14489,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.007824,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001166,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001981,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005285,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.091,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.042,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.048,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.045,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.441588,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.6428414200000001,"duration_s":0.75654,"completed_at":"2026-09-09T10:38:04.055Z","load_balancing_strategy":"primary","db_duration_s":0.108866,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1903gitlab # [ 420.326183] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:04.057Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"801ed46008e443847873141f","created_at":"2026-09-09T10:37:59.943Z","trace_propagation_headers":{"sentry-trace":"84c1dcf6fe254a95b1006de8a70a1a8f-59a90c063d7a426d","baggage":"sentry-trace_id=84c1dcf6fe254a95b1006de8a70a1a8f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VXX2CTBD9PQ48Z7F1CPJH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:37:59.947Z","job_size_bytes":185,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-801ed46008e443847873141f: start","job_status":"start","queue_duration_s":4.109941,"scheduling_latency_s":4.109962}1904gitlab # [ 420.347386] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:04.071Z","message":"changes: \"ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 refs/heads/master\\n\""}1905gitlab # [ 420.350425] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:04.138Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"fcf380898982da7f4f928fb2","created_at":"2026-09-09T10:38:04.135Z","trace_propagation_headers":{"sentry-trace":"84c1dcf6fe254a95b1006de8a70a1a8f-4ba3503c0f6b4803","baggage":"sentry-trace_id=84c1dcf6fe254a95b1006de8a70a1a8f,sentry-release=Unknown"},"correlation_id":"01M22VXX2CTBD9PQ48Z7F1CPJH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"15f4ac0b50f0ccb2a0111694","job_size_bytes":46,"pid":3419,"job_status":"deduplicated","message":"ProjectCacheWorker JID-fcf380898982da7f4f928fb2: deduplicated: until executing","deduplication.type":"until executing"}1906gitlab # [ 420.366944] gitaly[903]: time="2026-09-09T10:38:04.108Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:14.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:04.092" grpc.time_ms=16.26 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907gitlab # [ 420.380348] gitaly[903]: time="2026-09-09T10:38:04.130Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-09T10:38:14.027" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:38:04.117" grpc.time_ms=12.684 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1908gitlab # [ 420.393448] gitaly[903]: time="2026-09-09T10:38:04.180Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-09T10:38:14.075" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:04.166" grpc.time_ms=14.304 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1909gitlab # [ 420.406721] gitaly[903]: time="2026-09-09T10:38:04.206Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-09T10:38:34.188" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:04.188" grpc.time_ms=17.827 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1910gitlab # [ 420.421855] gitaly[903]: time="2026-09-09T10:38:04.238Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-09T10:38:14.137" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-09T10:38:04.227" grpc.time_ms=10.781 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1911gitlab # [ 420.453241] gitaly[903]: time="2026-09-09T10:38:04.272Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:14.165" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:04.256" grpc.time_ms=16.298 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1912gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5'1913gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', in 0.06 seconds)1914gitlab # [ 420.575224] nixbot[3537]: INFO: ::ffff:127.0.0.1:49088 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 HTTP/1.1" 200 OK1915gitlab # [ 420.636598] gitaly[903]: time="2026-09-09T10:38:04.455Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-09T10:38:14.003" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:04.453" grpc.time_ms=2.225 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1916gitlab # [ 420.675668] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:04.487Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"801ed46008e443847873141f","created_at":"2026-09-09T10:37:59.943Z","trace_propagation_headers":{"sentry-trace":"84c1dcf6fe254a95b1006de8a70a1a8f-59a90c063d7a426d","baggage":"sentry-trace_id=84c1dcf6fe254a95b1006de8a70a1a8f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VXX2CTBD9PQ48Z7F1CPJH","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:37:59.947Z","job_size_bytes":185,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-801ed46008e443847873141f: done: 0.429733 sec","job_status":"done","queue_duration_s":4.109941,"scheduling_latency_s":4.109962,"gitaly_calls":7,"gitaly_duration_s":0.117676,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.035644,"redis_read_bytes":501,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.004582,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001695,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005765,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.010716,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.012886,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.047,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.047,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.269298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007861,"exclusive_lock_hold_duration_s":0.02828846,"duration_s":0.429733,"completed_at":"2026-09-09T10:38:04.486Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044553,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1917gitlab # [ 420.767019] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:04.489Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"15f4ac0b50f0ccb2a0111694","created_at":"2026-09-09T10:38:01.525Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-dee782e5d3924e07","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:01.553Z","job_size_bytes":46,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-15f4ac0b50f0ccb2a0111694: start","job_status":"start","queue_duration_s":2.935992,"scheduling_latency_s":2.936022}1918gitlab # [ 420.786310] gitaly[903]: time="2026-09-09T10:38:04.567Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-09T16:38:04.556" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:38:04.556" grpc.time_ms=10.051 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919gitlab # [ 420.798309] gitaly[903]: time="2026-09-09T10:38:04.597Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-09T10:38:34.578" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:04.578" grpc.time_ms=18.849 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1920gitlab # [ 420.817426] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:04.635Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"15f4ac0b50f0ccb2a0111694","created_at":"2026-09-09T10:38:01.525Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-dee782e5d3924e07","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:01.553Z","job_size_bytes":46,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-15f4ac0b50f0ccb2a0111694: done: 0.14622 sec","job_status":"done","queue_duration_s":2.935992,"scheduling_latency_s":2.936022,"gitaly_calls":2,"gitaly_duration_s":0.035101,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010532,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001839,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000733,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002981,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003641,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001338,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004008,"duration_s":0.14622,"completed_at":"2026-09-09T10:38:04.635Z","load_balancing_strategy":"primary","db_duration_s":0.016914,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1921gitlab # [ 420.871239] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:04.638Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"79d7740037dee4e6ced494c6","created_at":"2026-09-09T10:38:01.579Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-dee782e5d3924e07","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:01.587Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-79d7740037dee4e6ced494c6: start","job_status":"start","queue_duration_s":3.050231,"scheduling_latency_s":3.050254}1922gitlab # [ 420.888408] gitaly[903]: time="2026-09-09T10:38:04.700Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT diskcache=98091228-b10b-4eba-9b0f-6da13509d01f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-09T16:38:04.668" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:04.669" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1923gitlab # [ 420.898086] gitaly[903]: time="2026-09-09T10:38:04.701Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=4 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-09T16:38:04.668" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:04.669" grpc.time_ms=31.67 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1924gitlab # [ 420.931410] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:04.750Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"79d7740037dee4e6ced494c6","created_at":"2026-09-09T10:38:01.579Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-dee782e5d3924e07","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:01.587Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-79d7740037dee4e6ced494c6: done: 0.111981 sec","job_status":"done","queue_duration_s":3.050231,"scheduling_latency_s":3.050254,"gitaly_calls":1,"gitaly_duration_s":0.034506,"redis_calls":15,"redis_duration_s":0.004272,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000583,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00073,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001369,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.026,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08071242,"duration_s":0.111981,"completed_at":"2026-09-09T10:38:04.750Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1925gitlab # [ 420.977673] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:04.752Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"18228fe83b8b578b6ba263bd","created_at":"2026-09-09T10:38:01.800Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-dee782e5d3924e07","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:01.805Z","job_size_bytes":23,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-18228fe83b8b578b6ba263bd: start","job_status":"start","queue_duration_s":2.947022,"scheduling_latency_s":2.947042}1926gitlab # [ 420.993146] gitaly[903]: time="2026-09-09T10:38:04.803Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-09T10:38:34.785" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:04.786" grpc.time_ms=17.059 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1927gitlab # [ 421.006204] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:04.815Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"18228fe83b8b578b6ba263bd","created_at":"2026-09-09T10:38:01.800Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-dee782e5d3924e07","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:01.805Z","job_size_bytes":23,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-18228fe83b8b578b6ba263bd: done: 0.063139 sec","job_status":"done","queue_duration_s":2.947022,"scheduling_latency_s":2.947042,"gitaly_calls":1,"gitaly_duration_s":0.019722,"redis_calls":16,"redis_duration_s":0.005304,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000372,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001498,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002451,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.063139,"completed_at":"2026-09-09T10:38:04.815Z","load_balancing_strategy":"primary","db_duration_s":0.004528,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1928gitlab # [ 421.052240] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:04.817Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"18b99208ab48178340a9fb2a","created_at":"2026-09-09T10:38:02.604Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-dee782e5d3924e07","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b4296104510049f72ec2fceb10f4a6a6609a82ebee76d49e485d528f540b7bab","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:02.616Z","job_size_bytes":467,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-18b99208ab48178340a9fb2a: start","job_status":"start","queue_duration_s":2.201019,"scheduling_latency_s":2.20104}1929gitlab # [ 421.069261] gitaly[903]: time="2026-09-09T10:38:04.849Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:34.847" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:04.848" grpc.time_ms=0.707 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1930gitlab # [ 421.081906] gitaly[903]: time="2026-09-09T10:38:04.866Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-09T10:38:14.001" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:04.852" grpc.time_ms=14.652 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931gitlab # [ 421.194553] gitaly[903]: time="2026-09-09T10:38:05.013Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-09T10:38:35.011" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:05.012" grpc.time_ms=1.061 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1932gitlab # [ 421.213975] gitaly[903]: time="2026-09-09T10:38:05.026Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=298 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-09T10:38:35.020" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:05.020" grpc.time_ms=5.544 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1933gitlab # [ 421.315876] gitaly[903]: time="2026-09-09T10:38:05.135Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:15.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:05.118" grpc.time_ms=15.973 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1934gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5'1935gitlab # [ 421.645527] nixbot[3537]: INFO: ::ffff:127.0.0.1:44300 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 HTTP/1.1" 200 OK1936gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', in 0.07 seconds)1937gitlab # [ 421.977935] gitaly[903]: time="2026-09-09T10:38:05.797Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-09T10:38:35.770" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:05.770" grpc.time_ms=26.409 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938gitlab # [ 422.020930] gitaly[903]: time="2026-09-09T10:38:05.821Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VVBPCMEJCCWP399QMZ4BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-09T10:38:35.802" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:05.802" grpc.time_ms=18.173 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 422.071340] sidekiq-cluster[3419]: {"severity":"WARN","time":"2026-09-09T10:38:05.889Z","class":"CreatePipelineWorker","correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"ea14dead70630b2e6c3eacbc59deaaa0f49dddb8","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"ea14dead70630b2e6c3eacbc59deaaa0f49dddb8","ref":"refs/heads/master"},"retry":0}1940gitlab # [ 422.092941] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:05.906Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"18b99208ab48178340a9fb2a","created_at":"2026-09-09T10:38:02.604Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-dee782e5d3924e07","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b4296104510049f72ec2fceb10f4a6a6609a82ebee76d49e485d528f540b7bab","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:02.616Z","job_size_bytes":467,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-18b99208ab48178340a9fb2a: done: 1.088684 sec","job_status":"done","queue_duration_s":2.201019,"scheduling_latency_s":2.20104,"gitaly_calls":7,"gitaly_duration_s":0.105456,"redis_calls":51,"redis_duration_s":0.014948,"redis_read_bytes":169,"redis_write_bytes":4166,"redis_cache_calls":4,"redis_cache_duration_s":0.001631,"redis_cache_read_bytes":10,"redis_cache_write_bytes":341,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006208,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001992,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003537,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00158,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.904045,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00066166,"duration_s":1.088684,"completed_at":"2026-09-09T10:38:05.905Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.080724,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1941gitlab # [ 422.177823] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:05.909Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"4ad63701-7abd-42c4-ae55-3304721f910f\"}"],"class":"WebHookWorker","jid":"08706d0cb79d2dbe0756be10","created_at":"2026-09-09T10:38:02.845Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-dee782e5d3924e07","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4db0b176258d38b13129d4e36d71d19a9e3c67b7edf28f53b7d55029d7530dbd","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:02.853Z","job_size_bytes":1751,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-08706d0cb79d2dbe0756be10: start","job_status":"start","queue_duration_s":3.055864,"scheduling_latency_s":3.055905}1942gitlab # [ 422.298474] nixbot[3537]: INFO: ::ffff:127.0.0.1:44306 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1943gitlab # [ 422.339088] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.156Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"4ad63701-7abd-42c4-ae55-3304721f910f\"}"],"class":"WebHookWorker","jid":"08706d0cb79d2dbe0756be10","created_at":"2026-09-09T10:38:02.845Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-dee782e5d3924e07","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4db0b176258d38b13129d4e36d71d19a9e3c67b7edf28f53b7d55029d7530dbd","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:02.853Z","job_size_bytes":1751,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-08706d0cb79d2dbe0756be10: done: 0.247353 sec","job_status":"done","queue_duration_s":3.055864,"scheduling_latency_s":3.055905,"redis_calls":19,"redis_duration_s":0.0072109999999999995,"redis_read_bytes":32,"redis_write_bytes":5366,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001695,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.00072,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002993,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001803,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0849801400000274,"cpu_s":0.136874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00092852,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.247353,"completed_at":"2026-09-09T10:38:06.156Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005473,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1944gitlab # [ 422.440320] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.160Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"28a46570c8d67a49e6b89e1d","created_at":"2026-09-09T10:38:03.553Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.566Z","job_size_bytes":23,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-28a46570c8d67a49e6b89e1d: start","job_status":"start","queue_duration_s":2.593965,"scheduling_latency_s":2.594009}1945gitlab # [ 422.484785] gitaly[903]: time="2026-09-09T10:38:06.302Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22VY3VJ5AY5904ACX3ETT52 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:06.284" grpc.time_ms=18.644 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1946gitlab # [ 422.511414] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:06 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1091947gitlab # [ 422.536863] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.355Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"28a46570c8d67a49e6b89e1d","created_at":"2026-09-09T10:38:03.553Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.566Z","job_size_bytes":23,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-28a46570c8d67a49e6b89e1d: done: 0.194695 sec","job_status":"done","queue_duration_s":2.593965,"scheduling_latency_s":2.594009,"redis_calls":10,"redis_duration_s":0.004383,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000822,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.150838,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00097396,"duration_s":0.194695,"completed_at":"2026-09-09T10:38:06.355Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03397,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1948gitlab # [ 422.617104] gitaly[903]: time="2026-09-09T10:38:06.422Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VY3Z2Y3GG6D0QCBRPP1ES grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:06.398" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1949gitlab # [ 422.628840] gitlab-workhorse[820]: time="2026-09-09T10:38:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671950gitlab # [ 422.630849] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:06 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1171951gitlab # [ 422.632973] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.358Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b72d0bae65de863720d8d7ec","created_at":"2026-09-09T10:38:03.781Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.794Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b72d0bae65de863720d8d7ec: start","job_status":"start","queue_duration_s":2.564179,"scheduling_latency_s":2.564221}1952gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5'1953gitlab # [ 422.649717] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.431Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b72d0bae65de863720d8d7ec","created_at":"2026-09-09T10:38:03.781Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.794Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b72d0bae65de863720d8d7ec: done: 0.073144 sec","job_status":"done","queue_duration_s":2.564179,"scheduling_latency_s":2.564221,"redis_calls":10,"redis_duration_s":0.007405,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000846,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00078,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067926,"duration_s":0.073144,"completed_at":"2026-09-09T10:38:06.431Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011602,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1954gitlab # [ 422.693020] gitaly[903]: time="2026-09-09T10:38:06.423Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY3Z2Y3GG6D0QCBRPP1ES grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:06.398" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1955gitlab # [ 422.706262] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.434Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"77f56877035d2783caa9d85c","created_at":"2026-09-09T10:38:03.821Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.832Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-77f56877035d2783caa9d85c: start","job_status":"start","queue_duration_s":2.601586,"scheduling_latency_s":2.601616}1956gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', in 0.08 seconds)1957gitlab # [ 422.722023] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.500Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"77f56877035d2783caa9d85c","created_at":"2026-09-09T10:38:03.821Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.832Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-77f56877035d2783caa9d85c: done: 0.066436 sec","job_status":"done","queue_duration_s":2.601586,"scheduling_latency_s":2.601616,"redis_calls":10,"redis_duration_s":0.005101,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000511,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003912,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000678,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042664,"duration_s":0.066436,"completed_at":"2026-09-09T10:38:06.500Z","load_balancing_strategy":"primary","db_duration_s":0.014155,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1958gitlab # [ 422.766618] gitaly[903]: time="2026-09-09T10:38:06.423Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY3Z2Y3GG6D0QCBRPP1ES grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:06.398" grpc.time_ms=24.44 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1959gitlab # [ 422.781103] gitlab-workhorse[820]: time="2026-09-09T10:38:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3361960gitlab # [ 422.782956] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:06 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 1271961gitlab # [ 422.784952] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.502Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"cd0d1806473ec9545b52ac9f","created_at":"2026-09-09T10:38:03.861Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.871Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-cd0d1806473ec9545b52ac9f: start","job_status":"start","queue_duration_s":2.630529,"scheduling_latency_s":2.630553}1962gitlab # [ 422.800061] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.573Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"cd0d1806473ec9545b52ac9f","created_at":"2026-09-09T10:38:03.861Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.871Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-cd0d1806473ec9545b52ac9f: done: 0.070581 sec","job_status":"done","queue_duration_s":2.630529,"scheduling_latency_s":2.630553,"redis_calls":13,"redis_duration_s":0.00417,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000351,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001531,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001734,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053678,"duration_s":0.070581,"completed_at":"2026-09-09T10:38:06.572Z","load_balancing_strategy":"primary","db_duration_s":0.015769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1963gitlab # [ 422.845005] nixbot[3537]: INFO: ::ffff:127.0.0.1:44310 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 HTTP/1.1" 200 OK1964gitlab # [ 422.846884] nixbot[3537]: {"ts": "2026-09-09T10:38:06.616Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1965gitlab # [ 422.849499] gitaly[903]: time="2026-09-09T10:38:06.552Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VY42T7VQBSEM54T37YEA0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:06.527" pid=903 remote_ip="2001:db8:1::1" request_sha=8399e45c66db1e376f1d192414e56b02c9fa65d8 response_bytes=336 span.kind=server system=grpc1966gitlab # [ 422.859744] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.575Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7469b58d206b0df842277357","created_at":"2026-09-09T10:38:03.873Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.882Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7469b58d206b0df842277357: start","job_status":"start","queue_duration_s":2.692602,"scheduling_latency_s":2.692625}1967gitlab # [ 422.876286] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.631Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7469b58d206b0df842277357","created_at":"2026-09-09T10:38:03.873Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.882Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7469b58d206b0df842277357: done: 0.055857 sec","job_status":"done","queue_duration_s":2.692602,"scheduling_latency_s":2.692625,"redis_calls":10,"redis_duration_s":0.003178,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000547,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001869,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000762,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009131,"duration_s":0.055857,"completed_at":"2026-09-09T10:38:06.630Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1968gitlab # [ 422.919645] gitaly[903]: time="2026-09-09T10:38:06.553Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1127 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY42T7VQBSEM54T37YEA0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:06.527" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1969gitlab # [ 422.933401] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.632Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"287aba854031c7e8c5443a2d","created_at":"2026-09-09T10:38:03.883Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.892Z","job_size_bytes":19,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-287aba854031c7e8c5443a2d: start","job_status":"start","queue_duration_s":2.740157,"scheduling_latency_s":2.740175}1970gitlab # [ 422.949359] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.685Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"287aba854031c7e8c5443a2d","created_at":"2026-09-09T10:38:03.883Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.892Z","job_size_bytes":19,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-287aba854031c7e8c5443a2d: done: 0.052715 sec","job_status":"done","queue_duration_s":2.740157,"scheduling_latency_s":2.740175,"redis_calls":11,"redis_duration_s":0.004113,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000665,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002947,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039132,"duration_s":0.052715,"completed_at":"2026-09-09T10:38:06.685Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006166,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1971gitlab # [ 422.993542] gitaly[903]: time="2026-09-09T10:38:06.553Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1127 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY42T7VQBSEM54T37YEA0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:06.527" grpc.time_ms=25.669 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1972gitlab # [ 423.007978] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.687Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"757f44ac3b504c6619bb001c","created_at":"2026-09-09T10:38:03.897Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.904Z","job_size_bytes":66,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-757f44ac3b504c6619bb001c: start","job_status":"start","queue_duration_s":2.782334,"scheduling_latency_s":2.782361}1973gitlab # [ 423.025093] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.733Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"757f44ac3b504c6619bb001c","created_at":"2026-09-09T10:38:03.897Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.904Z","job_size_bytes":66,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-757f44ac3b504c6619bb001c: done: 0.04686 sec","job_status":"done","queue_duration_s":2.782334,"scheduling_latency_s":2.782361,"redis_calls":10,"redis_duration_s":0.003495,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000953,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000666,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048646,"duration_s":0.04686,"completed_at":"2026-09-09T10:38:06.733Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1974gitlab # [ 423.069726] gitaly[903]: time="2026-09-09T10:38:06.724Z" level=info msg="finished unary call with code OK" catfile.duration_ms=5 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=5 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY49KZ1AYB2JKQESZJHGB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:36.317" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:06.718" grpc.time_ms=5.556 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975gitlab # [ 423.082547] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.735Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f28b12ab7f65411af9ed26fc","created_at":"2026-09-09T10:38:03.906Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.912Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f28b12ab7f65411af9ed26fc: start","job_status":"start","queue_duration_s":2.822689,"scheduling_latency_s":2.822706}1976gitlab # [ 423.098704] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.777Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f28b12ab7f65411af9ed26fc","created_at":"2026-09-09T10:38:03.906Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.912Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f28b12ab7f65411af9ed26fc: done: 0.041407 sec","job_status":"done","queue_duration_s":2.822689,"scheduling_latency_s":2.822706,"redis_calls":10,"redis_duration_s":0.001966,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001284,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000382,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026928,"duration_s":0.041407,"completed_at":"2026-09-09T10:38:06.776Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004376,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1977gitlab # [ 423.142861] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.778Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"bce80fc9f42c4f46cb5bc660","created_at":"2026-09-09T10:38:03.922Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.929Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-bce80fc9f42c4f46cb5bc660: start","job_status":"start","queue_duration_s":2.849155,"scheduling_latency_s":2.84917}1978gitlab # [ 423.159159] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.813Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"bce80fc9f42c4f46cb5bc660","created_at":"2026-09-09T10:38:03.922Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.929Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-bce80fc9f42c4f46cb5bc660: done: 0.034827 sec","job_status":"done","queue_duration_s":2.849155,"scheduling_latency_s":2.84917,"redis_calls":10,"redis_duration_s":0.002121,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000335,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001269,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000517,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032974,"duration_s":0.034827,"completed_at":"2026-09-09T10:38:06.813Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1979gitlab # [ 423.203902] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.814Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b071869b95bfdf0bdada8946","created_at":"2026-09-09T10:38:03.930Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.935Z","job_size_bytes":6,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b071869b95bfdf0bdada8946: start","job_status":"start","queue_duration_s":2.879012,"scheduling_latency_s":2.879027}1980gitlab # [ 423.219511] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.837Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b071869b95bfdf0bdada8946","created_at":"2026-09-09T10:38:03.930Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.935Z","job_size_bytes":6,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b071869b95bfdf0bdada8946: done: 0.022761 sec","job_status":"done","queue_duration_s":2.879012,"scheduling_latency_s":2.879027,"redis_calls":10,"redis_duration_s":0.00233,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001387,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032396,"duration_s":0.022761,"completed_at":"2026-09-09T10:38:06.837Z","load_balancing_strategy":"primary","db_duration_s":0.001713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1981gitlab # [ 423.263069] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:06.838Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"bdc605c382bd291bb80b1e6d","created_at":"2026-09-09T10:38:03.936Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.941Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-bdc605c382bd291bb80b1e6d: start","job_status":"start","queue_duration_s":2.897393,"scheduling_latency_s":2.897408}1982gitlab # [ 423.278509] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:07.006Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"bdc605c382bd291bb80b1e6d","created_at":"2026-09-09T10:38:03.936Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.941Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-bdc605c382bd291bb80b1e6d: done: 0.167274 sec","job_status":"done","queue_duration_s":2.897393,"scheduling_latency_s":2.897408,"redis_calls":10,"redis_duration_s":0.002525,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000553,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001462,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.153489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031972,"duration_s":0.167274,"completed_at":"2026-09-09T10:38:07.006Z","load_balancing_strategy":"primary","db_duration_s":0.005834,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1983gitlab # [ 423.321649] gitaly[903]: time="2026-09-09T10:38:07.035Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=5 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VY49KZ1AYB2JKQESZJHGB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:17.011" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:07.021" grpc.time_ms=14.126 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 423.335146] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:07.008Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"63e2a80258e2d91693647e38","created_at":"2026-09-09T10:38:03.949Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.955Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-63e2a80258e2d91693647e38: start","job_status":"start","queue_duration_s":3.05282,"scheduling_latency_s":3.052844}1985gitlab # [ 423.351552] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:07.075Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"63e2a80258e2d91693647e38","created_at":"2026-09-09T10:38:03.949Z","trace_propagation_headers":{"sentry-trace":"70c8a59655284b808e9234f794db60d7-6893f949aad64de7","baggage":"sentry-trace_id=70c8a59655284b808e9234f794db60d7,sentry-release=Unknown"},"correlation_id":"01M22VVJ0YBAE757HVSCQBJB16","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:03.955Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-63e2a80258e2d91693647e38: done: 0.0675 sec","job_status":"done","queue_duration_s":3.05282,"scheduling_latency_s":3.052844,"redis_calls":14,"redis_duration_s":0.002042,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000863,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023666,"duration_s":0.0675,"completed_at":"2026-09-09T10:38:07.075Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1986gitlab # [ 423.397693] gitaly[903]: time="2026-09-09T10:38:07.104Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH diskcache=5968d547-97c4-4327-9951-ae553933da37 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-09T16:38:07.095" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:07.096" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1987gitlab # [ 423.407696] gitaly[903]: time="2026-09-09T10:38:07.104Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-09T16:38:07.095" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:07.096" grpc.time_ms=8.643 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1988gitlab # [ 423.421202] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 5721989gitlab # [ 423.423690] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:07.076Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"81b609831750454c50d1b44e","created_at":"2026-09-09T10:38:04.152Z","trace_propagation_headers":{"sentry-trace":"84c1dcf6fe254a95b1006de8a70a1a8f-4ba3503c0f6b4803","baggage":"sentry-trace_id=84c1dcf6fe254a95b1006de8a70a1a8f,sentry-release=Unknown"},"correlation_id":"01M22VXX2CTBD9PQ48Z7F1CPJH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"79d7740037dee4e6ced494c6","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:04.157Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-81b609831750454c50d1b44e: start","job_status":"start","queue_duration_s":2.918934,"scheduling_latency_s":2.918953}1990gitlab # [ 423.440740] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:07.120Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"81b609831750454c50d1b44e","created_at":"2026-09-09T10:38:04.152Z","trace_propagation_headers":{"sentry-trace":"84c1dcf6fe254a95b1006de8a70a1a8f-4ba3503c0f6b4803","baggage":"sentry-trace_id=84c1dcf6fe254a95b1006de8a70a1a8f,sentry-release=Unknown"},"correlation_id":"01M22VXX2CTBD9PQ48Z7F1CPJH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"79d7740037dee4e6ced494c6","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:04.157Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-81b609831750454c50d1b44e: done: 0.043932 sec","job_status":"done","queue_duration_s":2.918934,"scheduling_latency_s":2.918953,"gitaly_calls":1,"gitaly_duration_s":0.011012,"redis_calls":12,"redis_duration_s":0.001653,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000671,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000324,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000658,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02532392,"duration_s":0.043932,"completed_at":"2026-09-09T10:38:07.120Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004611,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1991gitlab # [ 423.487011] nixbot[3537]: {"ts": "2026-09-09T10:38:07.217Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 \"HTTP/1.1 201 Created\""}1992gitlab # [ 423.490321] gitaly[903]: time="2026-09-09T10:38:07.147Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:37.145" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:07.146" grpc.time_ms=1.03 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1993gitlab # [ 423.502489] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:07.122Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"1773f1fdd26fd506d8ff676c","created_at":"2026-09-09T10:38:04.382Z","trace_propagation_headers":{"sentry-trace":"84c1dcf6fe254a95b1006de8a70a1a8f-4ba3503c0f6b4803","baggage":"sentry-trace_id=84c1dcf6fe254a95b1006de8a70a1a8f,sentry-release=Unknown"},"correlation_id":"01M22VXX2CTBD9PQ48Z7F1CPJH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5a2a00ae6a6f630361b8902e9bc7e0095a3dbf2c345cadde0570fc2b0145c91f","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:04.388Z","job_size_bytes":467,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-1773f1fdd26fd506d8ff676c: start","job_status":"start","queue_duration_s":2.733879,"scheduling_latency_s":2.733897}1994gitlab # [ 423.519764] gitaly[903]: time="2026-09-09T10:38:07.162Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-09T10:38:17.039" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:07.150" grpc.time_ms=11.044 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995gitlab # [ 423.532832] gitaly[903]: time="2026-09-09T10:38:07.201Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-09T10:38:37.199" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:07.200" grpc.time_ms=1.219 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1996gitlab # [ 423.545076] gitaly[903]: time="2026-09-09T10:38:07.212Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=170 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-09T10:38:37.206" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:07.207" grpc.time_ms=4.728 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1997gitlab # [ 423.561005] gitaly[903]: time="2026-09-09T10:38:07.261Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:17.140" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:07.250" grpc.time_ms=10.808 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998gitlab # [ 423.622325] gitaly[903]: time="2026-09-09T10:38:07.441Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY4VNKF26HRAH84BTCDP1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:37.039" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:07.440" grpc.time_ms=1.21 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999gitlab # [ 423.681485] gitaly[903]: time="2026-09-09T10:38:07.500Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VY4VNKF26HRAH84BTCDP1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:17.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:07.486" grpc.time_ms=14.052 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5'2001gitlab # [ 423.739475] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3352002gitlab # [ 423.747543] nixbot[3537]: {"ts": "2026-09-09T10:38:07.559Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 \"HTTP/1.1 201 Created\""}2003gitlab # [ 423.792959] nixbot[3537]: INFO: ::ffff:127.0.0.1:44326 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 HTTP/1.1" 200 OK2004gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', in 0.06 seconds)2005gitlab # [ 423.872257] gitaly[903]: time="2026-09-09T10:38:07.691Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY56GRRBPSNSY7YHEF2X7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:37.489" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:07.689" grpc.time_ms=1.11 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2006gitlab # [ 423.996141] gitaly[903]: time="2026-09-09T10:38:07.815Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-09T10:38:37.790" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:07.790" grpc.time_ms=24.058 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2007gitlab # [ 424.023514] gitaly[903]: time="2026-09-09T10:38:07.821Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M22VY56GRRBPSNSY7YHEF2X7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:17.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:07.802" grpc.time_ms=18.984 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2008gitlab # [ 424.041811] gitaly[903]: time="2026-09-09T10:38:07.848Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VXX2CTBD9PQ48Z7F1CPJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-09T10:38:37.818" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:07.819" grpc.time_ms=28.589 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2009gitlab # [ 424.058090] sidekiq-cluster[3419]: {"severity":"WARN","time":"2026-09-09T10:38:07.876Z","class":"CreatePipelineWorker","correlation_id":"01M22VXX2CTBD9PQ48Z7F1CPJH","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"ea14dead70630b2e6c3eacbc59deaaa0f49dddb8","after":"f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5","ref":"refs/heads/master"},"retry":0}2010gitlab # [ 424.066902] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3092011gitlab # [ 424.070376] nixbot[3537]: {"ts": "2026-09-09T10:38:07.879Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ea14dead70630b2e6c3eacbc59deaaa0f49dddb8 \"HTTP/1.1 201 Created\""}2012gitlab # [ 424.073804] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:07.890Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"1773f1fdd26fd506d8ff676c","created_at":"2026-09-09T10:38:04.382Z","trace_propagation_headers":{"sentry-trace":"84c1dcf6fe254a95b1006de8a70a1a8f-4ba3503c0f6b4803","baggage":"sentry-trace_id=84c1dcf6fe254a95b1006de8a70a1a8f,sentry-release=Unknown"},"correlation_id":"01M22VXX2CTBD9PQ48Z7F1CPJH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5a2a00ae6a6f630361b8902e9bc7e0095a3dbf2c345cadde0570fc2b0145c91f","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:04.388Z","job_size_bytes":467,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-1773f1fdd26fd506d8ff676c: done: 0.768307 sec","job_status":"done","queue_duration_s":2.733879,"scheduling_latency_s":2.733897,"gitaly_calls":7,"gitaly_duration_s":0.105996,"redis_calls":33,"redis_duration_s":0.006032,"redis_read_bytes":184,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000801,"redis_cache_read_bytes":43,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001306,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002787,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.635447,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.768307,"completed_at":"2026-09-09T10:38:07.890Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028001,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2013gitlab # [ 424.125093] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:07.894Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"84d3895e-8b17-4942-8025-0488d1f02cb6\"}"],"class":"WebHookWorker","jid":"1571d60d5c384448337f659a","created_at":"2026-09-09T10:38:04.421Z","trace_propagation_headers":{"sentry-trace":"84c1dcf6fe254a95b1006de8a70a1a8f-4ba3503c0f6b4803","baggage":"sentry-trace_id=84c1dcf6fe254a95b1006de8a70a1a8f,sentry-release=Unknown"},"correlation_id":"01M22VXX2CTBD9PQ48Z7F1CPJH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:727cf5ce366f8bb6dcce9ed828cd57395e1d0142a451f57ee6becd7b6e40089f","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:04.426Z","job_size_bytes":1749,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1571d60d5c384448337f659a: start","job_status":"start","queue_duration_s":3.467907,"scheduling_latency_s":3.467952}2014gitlab # [ 424.143733] nixbot[3537]: INFO: ::ffff:127.0.0.1:44332 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2015gitlab # [ 424.145085] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:07.962Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"84d3895e-8b17-4942-8025-0488d1f02cb6\"}"],"class":"WebHookWorker","jid":"1571d60d5c384448337f659a","created_at":"2026-09-09T10:38:04.421Z","trace_propagation_headers":{"sentry-trace":"84c1dcf6fe254a95b1006de8a70a1a8f-4ba3503c0f6b4803","baggage":"sentry-trace_id=84c1dcf6fe254a95b1006de8a70a1a8f,sentry-release=Unknown"},"correlation_id":"01M22VXX2CTBD9PQ48Z7F1CPJH","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:727cf5ce366f8bb6dcce9ed828cd57395e1d0142a451f57ee6becd7b6e40089f","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:04.426Z","job_size_bytes":1749,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1571d60d5c384448337f659a: done: 0.068398 sec","job_status":"done","queue_duration_s":3.467907,"scheduling_latency_s":3.467952,"redis_calls":14,"redis_duration_s":0.006227,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000468,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004504,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001255,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.007122379999998429,"cpu_s":0.044475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.068398,"completed_at":"2026-09-09T10:38:07.962Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002507,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2016gitlab # [ 424.192498] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:07.967Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"b169f30e44a9f6d458e71ed8","created_at":"2026-09-09T10:38:04.611Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-6f19b49333ee45ad","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:04.618Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-b169f30e44a9f6d458e71ed8: start","job_status":"start","queue_duration_s":3.348605,"scheduling_latency_s":3.348645}2017gitlab # [ 424.208051] gitaly[903]: time="2026-09-09T10:38:08.019Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M22VY5HX91JK1HDK9CGZVCTH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:08.000" grpc.time_ms=19.343 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2018gitlab # [ 424.220850] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 862019gitlab # [ 424.242332] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.060Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"b169f30e44a9f6d458e71ed8","created_at":"2026-09-09T10:38:04.611Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-6f19b49333ee45ad","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:04.618Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-b169f30e44a9f6d458e71ed8: done: 0.0939 sec","job_status":"done","queue_duration_s":3.348605,"scheduling_latency_s":3.348645,"redis_calls":19,"redis_duration_s":0.009742,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002434,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000644,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.004883,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001781,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0139005,"duration_s":0.0939,"completed_at":"2026-09-09T10:38:08.060Z","load_balancing_strategy":"primary","db_duration_s":0.010755,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2020gitlab # [ 424.286405] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.063Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","08706d0cb79d2dbe0756be10"],"class":"WebHooks::LogExecutionWorker","jid":"8161287d5dd9857b254187ef","created_at":"2026-09-09T10:38:06.122Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-b34dc1efe5344374","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:410b49bd798ac85792d436deb925c4f1579cf04a5486ae8b39dba2c9004b880c","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:06.134Z","job_size_bytes":2591,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-8161287d5dd9857b254187ef: start","job_status":"start","queue_duration_s":1.928772,"scheduling_latency_s":1.928801}2021gitlab # [ 424.311499] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.130Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","08706d0cb79d2dbe0756be10"],"class":"WebHooks::LogExecutionWorker","jid":"8161287d5dd9857b254187ef","created_at":"2026-09-09T10:38:06.122Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-b34dc1efe5344374","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:410b49bd798ac85792d436deb925c4f1579cf04a5486ae8b39dba2c9004b880c","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:06.134Z","job_size_bytes":2591,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-8161287d5dd9857b254187ef: done: 0.066972 sec","job_status":"done","queue_duration_s":1.928772,"scheduling_latency_s":1.928801,"redis_calls":10,"redis_duration_s":0.002695,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000654,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001643,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000398,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029032,"duration_s":0.066972,"completed_at":"2026-09-09T10:38:08.130Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2022gitlab # [ 424.355706] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.132Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"ca4b96ae36240014f036c5dd","created_at":"2026-09-09T10:38:07.176Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-22bc4a35ed684545","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:07.184Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ca4b96ae36240014f036c5dd: start","job_status":"start","queue_duration_s":0.948031,"scheduling_latency_s":0.948054}2023gitlab # [ 424.371537] gitlab-workhorse[820]: time="2026-09-09T10:38:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672024gitlab # [ 424.373478] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1232025gitlab # [ 424.375319] gitaly[903]: time="2026-09-09T10:38:08.145Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VY5MQESVMVKAA8V1V0HZ5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:08.127" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2026gitlab # [ 424.385631] gitaly[903]: time="2026-09-09T10:38:08.145Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY5MQESVMVKAA8V1V0HZ5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:08.127" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2027gitlab # [ 424.399843] gitaly[903]: time="2026-09-09T10:38:08.146Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY5MQESVMVKAA8V1V0HZ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:08.127" grpc.time_ms=18.245 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2028gitlab # [ 424.459227] gitaly[903]: time="2026-09-09T10:38:08.278Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M22VY5T0QHAYGAGFBP6A2N3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:08.269" grpc.time_ms=8.706 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2029gitlab # [ 424.472566] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 852030gitlab # [ 424.474585] gitaly[903]: time="2026-09-09T10:38:08.292Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VY49KZ1AYB2JKQESZJHGB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:08.291" grpc.time_ms=0.407 pid=903 span.kind=server system=grpc2031gitlab # [ 424.498346] gitaly[903]: time="2026-09-09T10:38:08.317Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VY49KZ1AYB2JKQESZJHGB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:08.316" grpc.time_ms=0.554 pid=903 span.kind=server system=grpc2032gitlab # [ 424.520183] gitaly[903]: time="2026-09-09T10:38:08.339Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VY49KZ1AYB2JKQESZJHGB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:08.339" grpc.time_ms=0.427 pid=903 span.kind=server system=grpc2033gitlab # [ 424.530380] gitaly[903]: time="2026-09-09T10:38:08.349Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VY49KZ1AYB2JKQESZJHGB diskcache=e8aadaa6-d6c5-4a52-bfe9-aaf27dbc1983 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:38:38.251" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:08.251" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2034gitlab # [ 424.540884] gitaly[903]: time="2026-09-09T10:38:08.349Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=95 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7296 command.oublock=0 command.real_time_ms=90 command.spawn_token_fork_ms=0 command.system_time_ms=50 command.user_time_ms=45 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY49KZ1AYB2JKQESZJHGB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:38:38.251" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:08.251" grpc.time_ms=97.373 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035gitlab # [ 424.554136] gitaly[903]: time="2026-09-09T10:38:08.350Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VY5WRMENXX7XYAAWTPXTG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:08.341" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2036gitlab # [ 424.564677] gitlab-workhorse[820]: time="2026-09-09T10:38:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672037gitlab # [ 424.566509] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 702038gitlab # [ 424.568452] gitaly[903]: time="2026-09-09T10:38:08.350Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY5WRMENXX7XYAAWTPXTG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:08.341" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2039gitlab # [ 424.581526] gitaly[903]: time="2026-09-09T10:38:08.350Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY5WRMENXX7XYAAWTPXTG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:08.341" grpc.time_ms=8.599 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2040gitlab # [ 424.596088] gitaly[903]: time="2026-09-09T10:38:08.412Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VY49KZ1AYB2JKQESZJHGB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-09T10:38:38.409" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:08.409" grpc.time_ms=2.6 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2041gitlab # [ 424.628465] gitaly[903]: time="2026-09-09T10:38:08.447Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY49KZ1AYB2JKQESZJHGB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:38.445" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:08.446" grpc.time_ms=0.91 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042gitlab # [ 424.641516] gitaly[903]: time="2026-09-09T10:38:08.457Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VY6053PJ8SWYVWJEH67TA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:08.447" grpc.time_ms=9.639 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2043gitlab # [ 424.654962] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.459Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"ca4b96ae36240014f036c5dd","created_at":"2026-09-09T10:38:07.176Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-22bc4a35ed684545","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:07.184Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3419,"job_status":"rescheduled","message":"PipelineProcessWorker JID-ca4b96ae36240014f036c5dd: rescheduled"}2044gitlab # [ 424.669825] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.466Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"ca4b96ae36240014f036c5dd","created_at":"2026-09-09T10:38:07.176Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-22bc4a35ed684545","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:07.184Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ca4b96ae36240014f036c5dd: done: 0.334677 sec","job_status":"done","queue_duration_s":0.948031,"scheduling_latency_s":0.948054,"gitaly_calls":3,"gitaly_duration_s":0.111761,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016409,"redis_read_bytes":148,"redis_write_bytes":18015,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000749,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001521,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003042,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.005773,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000299,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000649,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003627,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.012,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.171416,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.2846601,"duration_s":0.334677,"completed_at":"2026-09-09T10:38:08.466Z","load_balancing_strategy":"primary","db_duration_s":0.04565,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2045gitlab # [ 424.719881] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 682046gitlab # [ 424.722080] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.468Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1571d60d5c384448337f659a"],"class":"WebHooks::LogExecutionWorker","jid":"a0375d9d5f48489cf1cd3a2b","created_at":"2026-09-09T10:38:07.941Z","trace_propagation_headers":{"sentry-trace":"84c1dcf6fe254a95b1006de8a70a1a8f-73d2da07cb0d4211","baggage":"sentry-trace_id=84c1dcf6fe254a95b1006de8a70a1a8f,sentry-release=Unknown"},"correlation_id":"01M22VXX2CTBD9PQ48Z7F1CPJH","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3c49e9fb6bf1b0f1fe3590f43fbbff21f67ccf707c6dc15be7960ed329ac8d76","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:07.948Z","job_size_bytes":2592,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a0375d9d5f48489cf1cd3a2b: start","job_status":"start","queue_duration_s":0.51945,"scheduling_latency_s":0.519473}2047gitlab # [ 424.738726] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.493Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1571d60d5c384448337f659a"],"class":"WebHooks::LogExecutionWorker","jid":"a0375d9d5f48489cf1cd3a2b","created_at":"2026-09-09T10:38:07.941Z","trace_propagation_headers":{"sentry-trace":"84c1dcf6fe254a95b1006de8a70a1a8f-73d2da07cb0d4211","baggage":"sentry-trace_id=84c1dcf6fe254a95b1006de8a70a1a8f,sentry-release=Unknown"},"correlation_id":"01M22VXX2CTBD9PQ48Z7F1CPJH","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3c49e9fb6bf1b0f1fe3590f43fbbff21f67ccf707c6dc15be7960ed329ac8d76","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:07.948Z","job_size_bytes":2592,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a0375d9d5f48489cf1cd3a2b: done: 0.025273 sec","job_status":"done","queue_duration_s":0.51945,"scheduling_latency_s":0.519473,"redis_calls":7,"redis_duration_s":0.001354,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00104,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000314,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025273,"completed_at":"2026-09-09T10:38:08.493Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002758,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2048gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5'2049gitlab # [ 424.781809] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.494Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"c090886341711e0fb185bc65","created_at":"2026-09-09T10:38:08.037Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-df22ab3c529d42cf","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.047Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-c090886341711e0fb185bc65: start","job_status":"start","queue_duration_s":0.447716,"scheduling_latency_s":0.447738}2050gitlab # [ 424.798365] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.597Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"c090886341711e0fb185bc65","created_at":"2026-09-09T10:38:08.037Z","trace_propagation_headers":{"sentry-trace":"247302a9f5c541148276f0e7ca8ff393-df22ab3c529d42cf","baggage":"sentry-trace_id=247302a9f5c541148276f0e7ca8ff393,sentry-release=Unknown"},"correlation_id":"01M22VVBPCMEJCCWP399QMZ4BT","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.047Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-c090886341711e0fb185bc65: done: 0.102151 sec","job_status":"done","queue_duration_s":0.447716,"scheduling_latency_s":0.447738,"redis_calls":11,"redis_duration_s":0.002189,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000417,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001424,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000348,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022248,"duration_s":0.102151,"completed_at":"2026-09-09T10:38:08.596Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2051gitlab # [ 424.841510] gitaly[903]: time="2026-09-09T10:38:08.578Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VY62CVYGYNMEB3FPKYMMV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:08.554" pid=903 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2052gitlab # [ 424.852133] gitlab-workhorse[820]: time="2026-09-09T10:38:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162053gitlab # [ 424.853968] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1192054gitlab # [ 424.855882] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.598Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bca8e0516e96da219489dfc5","created_at":"2026-09-09T10:38:08.241Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.243Z","job_size_bytes":23,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bca8e0516e96da219489dfc5: start","job_status":"start","queue_duration_s":0.355023,"scheduling_latency_s":0.355042}2055gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', in 0.09 seconds)2056(finished: subtest: push delivers the webhook, in 88.59 seconds)2057subtest: eval and build post commit statuses2058gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses2059gitlab # [ 424.872508] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.647Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bca8e0516e96da219489dfc5","created_at":"2026-09-09T10:38:08.241Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.243Z","job_size_bytes":23,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bca8e0516e96da219489dfc5: done: 0.049044 sec","job_status":"done","queue_duration_s":0.355023,"scheduling_latency_s":0.355042,"redis_calls":7,"redis_duration_s":0.0013909999999999999,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049044,"completed_at":"2026-09-09T10:38:08.647Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010886,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2060gitlab # [ 424.915204] gitaly[903]: time="2026-09-09T10:38:08.579Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY62CVYGYNMEB3FPKYMMV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:08.554" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2061gitlab # [ 424.928963] nixbot[3537]: INFO: ::ffff:127.0.0.1:44344 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 HTTP/1.1" 200 OK2062gitlab # [ 424.930870] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.649Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"83e09b4bfbd893d5be3676d6","created_at":"2026-09-09T10:38:08.355Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.358Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-83e09b4bfbd893d5be3676d6: start","job_status":"start","queue_duration_s":0.290783,"scheduling_latency_s":0.2908}2063gitlab # [ 424.947075] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.679Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"83e09b4bfbd893d5be3676d6","created_at":"2026-09-09T10:38:08.355Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.358Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-83e09b4bfbd893d5be3676d6: done: 0.030517 sec","job_status":"done","queue_duration_s":0.290783,"scheduling_latency_s":0.2908,"redis_calls":7,"redis_duration_s":0.001669,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030517,"completed_at":"2026-09-09T10:38:08.679Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2064gitlab # [ 424.989428] gitaly[903]: time="2026-09-09T10:38:08.579Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY62CVYGYNMEB3FPKYMMV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:08.554" grpc.time_ms=24.803 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2065gitlab # [ 425.004441] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.681Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dc0b8eb720583c95a7e64880","created_at":"2026-09-09T10:38:08.365Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.370Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dc0b8eb720583c95a7e64880: start","job_status":"start","queue_duration_s":0.311614,"scheduling_latency_s":0.311633}2066gitlab # [ 425.021021] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.720Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"dc0b8eb720583c95a7e64880","created_at":"2026-09-09T10:38:08.365Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.370Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-dc0b8eb720583c95a7e64880: done: 0.038743 sec","job_status":"done","queue_duration_s":0.311614,"scheduling_latency_s":0.311633,"redis_calls":7,"redis_duration_s":0.006092,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038743,"completed_at":"2026-09-09T10:38:08.720Z","load_balancing_strategy":"primary","db_duration_s":0.00388,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2067gitlab # [ 425.063593] gitaly[903]: time="2026-09-09T10:38:08.704Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY67ENMY2T6S1WKT0T067 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:38.303" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:08.703" grpc.time_ms=0.863 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068gitlab # [ 425.079161] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.722Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"369165e5b7e02ea3f5b33743","created_at":"2026-09-09T10:38:08.379Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.381Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-369165e5b7e02ea3f5b33743: start","job_status":"start","queue_duration_s":0.340997,"scheduling_latency_s":0.341016}2069gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses, in 0.22 seconds)2070gitlab # [ 425.094524] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.757Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"369165e5b7e02ea3f5b33743","created_at":"2026-09-09T10:38:08.379Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.381Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-369165e5b7e02ea3f5b33743: done: 0.035402 sec","job_status":"done","queue_duration_s":0.340997,"scheduling_latency_s":0.341016,"redis_calls":10,"redis_duration_s":0.004378,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002272,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00129,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000816,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035402,"completed_at":"2026-09-09T10:38:08.757Z","load_balancing_strategy":"primary","db_duration_s":0.003893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2071gitlab # [ 425.137553] gitaly[903]: time="2026-09-09T10:38:08.728Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=8 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22VY67ENMY2T6S1WKT0T067 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-09T10:38:38.315" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:08.715" grpc.time_ms=13.074 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab # [ 425.151222] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 1752073gitlab # [ 425.154343] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.758Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6a425e4db105e9a44b2171d8","created_at":"2026-09-09T10:38:08.381Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.383Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6a425e4db105e9a44b2171d8: start","job_status":"start","queue_duration_s":0.374943,"scheduling_latency_s":0.37496}2074gitlab # [ 425.170834] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.786Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6a425e4db105e9a44b2171d8","created_at":"2026-09-09T10:38:08.381Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.383Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6a425e4db105e9a44b2171d8: done: 0.027541 sec","job_status":"done","queue_duration_s":0.374943,"scheduling_latency_s":0.37496,"redis_calls":7,"redis_duration_s":0.0022689999999999997,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001906,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000363,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027541,"completed_at":"2026-09-09T10:38:08.786Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00387,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2075gitlab # [ 425.213328] gitaly[903]: time="2026-09-09T10:38:08.748Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VY67ENMY2T6S1WKT0T067 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:18.056" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:08.736" grpc.time_ms=11.228 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 425.227740] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.787Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d3e1cf662b8a803f0b548593","created_at":"2026-09-09T10:38:08.384Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.386Z","job_size_bytes":19,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d3e1cf662b8a803f0b548593: start","job_status":"start","queue_duration_s":0.401371,"scheduling_latency_s":0.401389}2077gitlab # [ 425.244339] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.811Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d3e1cf662b8a803f0b548593","created_at":"2026-09-09T10:38:08.384Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.386Z","job_size_bytes":19,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d3e1cf662b8a803f0b548593: done: 0.02366 sec","job_status":"done","queue_duration_s":0.401371,"scheduling_latency_s":0.401389,"redis_calls":8,"redis_duration_s":0.001348,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001028,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02366,"completed_at":"2026-09-09T10:38:08.811Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2078gitlab # [ 425.286093] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4232079gitlab # [ 425.288576] gitaly[903]: time="2026-09-09T10:38:08.820Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M22VY67ENMY2T6S1WKT0T067 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-09T10:38:18.138" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:38:08.819" grpc.time_ms=0.724 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2080gitlab # [ 425.299473] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.812Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2ef0bbcf0bf9125672aa1c46","created_at":"2026-09-09T10:38:08.387Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.390Z","job_size_bytes":66,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2ef0bbcf0bf9125672aa1c46: start","job_status":"start","queue_duration_s":0.42267,"scheduling_latency_s":0.422688}2081gitlab # [ 425.316472] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.838Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"2ef0bbcf0bf9125672aa1c46","created_at":"2026-09-09T10:38:08.387Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.390Z","job_size_bytes":66,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-2ef0bbcf0bf9125672aa1c46: done: 0.025455 sec","job_status":"done","queue_duration_s":0.42267,"scheduling_latency_s":0.422688,"redis_calls":7,"redis_duration_s":0.0013549999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000401,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025455,"completed_at":"2026-09-09T10:38:08.838Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002446,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2082gitlab # [ 425.360251] nixbot[3537]: {"ts": "2026-09-09T10:38:09.047Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 \"HTTP/1.1 201 Created\""}2083gitlab # [ 425.362978] nixbot[3537]: {"ts": "2026-09-09T10:38:09.062Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-f5b5ea6a59b6-5"}2084gitlab # [ 425.365366] gitaly[903]: time="2026-09-09T10:38:08.842Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY6B4TJB5M8HWCXJHA7Y8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:38.441" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:08.841" grpc.time_ms=0.862 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab # [ 425.377951] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.843Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"46c682a1a89937028ab3b19c","created_at":"2026-09-09T10:38:08.390Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.392Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-46c682a1a89937028ab3b19c: start","job_status":"start","queue_duration_s":0.450788,"scheduling_latency_s":0.450809}2086gitlab # [ 425.393908] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.870Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"46c682a1a89937028ab3b19c","created_at":"2026-09-09T10:38:08.390Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.392Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-46c682a1a89937028ab3b19c: done: 0.027985 sec","job_status":"done","queue_duration_s":0.450788,"scheduling_latency_s":0.450809,"redis_calls":7,"redis_duration_s":0.001193,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000388,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027985,"completed_at":"2026-09-09T10:38:08.870Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2087gitlab # [ 425.436594] gitaly[903]: time="2026-09-09T10:38:08.844Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY67ENMY2T6S1WKT0T067 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-09T10:38:18.146" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:08.826" grpc.time_ms=17.682 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 425.449612] gitaly[903]: time="2026-09-09T10:38:08.903Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VY67ENMY2T6S1WKT0T067 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:08.899" grpc.time_ms=3.606 pid=903 span.kind=server system=grpc2089gitlab # [ 425.459202] nixbot[3537]: {"ts": "2026-09-09T10:38:09.243Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-f5b5ea6a59b6-5", "argv0": "bwrap"}2090gitlab # [ 425.461705] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.872Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"81e4c9143a9952aa891c430b","created_at":"2026-09-09T10:38:08.393Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.394Z","job_size_bytes":6,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-81e4c9143a9952aa891c430b: start","job_status":"start","queue_duration_s":0.477621,"scheduling_latency_s":0.477643}2091gitlab # [ 425.477653] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.886Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"81e4c9143a9952aa891c430b","created_at":"2026-09-09T10:38:08.393Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.394Z","job_size_bytes":6,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-81e4c9143a9952aa891c430b: done: 0.014601 sec","job_status":"done","queue_duration_s":0.477621,"scheduling_latency_s":0.477643,"redis_calls":7,"redis_duration_s":0.000987,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014601,"completed_at":"2026-09-09T10:38:08.886Z","load_balancing_strategy":"primary","db_duration_s":0.000315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2092gitlab # [ 425.519092] gitaly[903]: time="2026-09-09T10:38:08.939Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VY67ENMY2T6S1WKT0T067 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:08.939" grpc.time_ms=0.489 pid=903 span.kind=server system=grpc2093gitlab # [ 425.528732] gitaly[903]: time="2026-09-09T10:38:08.946Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VY67ENMY2T6S1WKT0T067 diskcache=32108bac-931f-40c6-aaa3-a77a21260cf7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-09T10:38:18.170" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:38:08.850" pid=903 ref=refs/keep-around/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 remote_ip="2001:db8:1::1" revision=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 span.kind=server system=grpc username=root2094gitlab # [ 425.540366] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.887Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"becad54d8050a8e234861e5e","created_at":"2026-09-09T10:38:08.395Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.396Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-becad54d8050a8e234861e5e: start","job_status":"start","queue_duration_s":0.491229,"scheduling_latency_s":0.491245}2095gitlab # [ 425.555760] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.911Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"becad54d8050a8e234861e5e","created_at":"2026-09-09T10:38:08.395Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.396Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-becad54d8050a8e234861e5e: done: 0.023685 sec","job_status":"done","queue_duration_s":0.491229,"scheduling_latency_s":0.491245,"redis_calls":7,"redis_duration_s":0.000936,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000675,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023685,"completed_at":"2026-09-09T10:38:08.911Z","load_balancing_strategy":"primary","db_duration_s":0.002905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2096gitlab # [ 425.597485] gitaly[903]: time="2026-09-09T10:38:08.946Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=72 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5205 command.oublock=8 command.real_time_ms=90 command.spawn_token_fork_ms=1 command.system_time_ms=33 command.user_time_ms=39 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY67ENMY2T6S1WKT0T067 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-09T10:38:18.170" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-09T10:38:08.850" grpc.time_ms=95.779 pid=903 ref=refs/keep-around/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 remote_ip="2001:db8:1::1" revision=f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 span.kind=server system=grpc username=root2097gitlab # [ 425.612306] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.912Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5101f204b964aecdebd16753","created_at":"2026-09-09T10:38:08.459Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.461Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5101f204b964aecdebd16753: start","job_status":"start","queue_duration_s":0.451049,"scheduling_latency_s":0.451066}2098gitlab # [ 425.627765] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.939Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"5101f204b964aecdebd16753","created_at":"2026-09-09T10:38:08.459Z","trace_propagation_headers":{"sentry-trace":"12f146212906428c82b4534e39b3d980-00cb55c9cee74657","baggage":"sentry-trace_id=12f146212906428c82b4534e39b3d980,sentry-release=Unknown"},"correlation_id":"01M22VY49KZ1AYB2JKQESZJHGB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.461Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5101f204b964aecdebd16753: done: 0.026709 sec","job_status":"done","queue_duration_s":0.451049,"scheduling_latency_s":0.451066,"redis_calls":8,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026709,"completed_at":"2026-09-09T10:38:08.939Z","load_balancing_strategy":"primary","db_duration_s":0.003301,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2099gitlab # [ 425.670251] gitaly[903]: time="2026-09-09T10:38:08.950Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY67ENMY2T6S1WKT0T067 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:38.549" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:08.949" grpc.time_ms=0.434 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab # [ 425.682771] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:08.967Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b29f12e54550b7bcc189f62c","created_at":"2026-09-09T10:38:08.961Z","trace_propagation_headers":{"sentry-trace":"3a7ad008dbaa4c7abc136e42d990bdee-5ffd35689ae14aab","baggage":"sentry-trace_id=3a7ad008dbaa4c7abc136e42d990bdee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VY67ENMY2T6S1WKT0T067","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.965Z","job_size_bytes":65,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b29f12e54550b7bcc189f62c: start","job_status":"start","queue_duration_s":0.001506,"scheduling_latency_s":0.001525}2101gitlab # [ 425.698836] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:09.000Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b29f12e54550b7bcc189f62c","created_at":"2026-09-09T10:38:08.961Z","trace_propagation_headers":{"sentry-trace":"3a7ad008dbaa4c7abc136e42d990bdee-5ffd35689ae14aab","baggage":"sentry-trace_id=3a7ad008dbaa4c7abc136e42d990bdee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VY67ENMY2T6S1WKT0T067","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.965Z","job_size_bytes":65,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b29f12e54550b7bcc189f62c: done: 0.033471 sec","job_status":"done","queue_duration_s":0.001506,"scheduling_latency_s":0.001525,"redis_calls":7,"redis_duration_s":0.0031209999999999996,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000338,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033471,"completed_at":"2026-09-09T10:38:09.000Z","load_balancing_strategy":"primary","db_duration_s":0.005568,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2102gitlab # [ 425.740285] gitaly[903]: time="2026-09-09T10:38:09.146Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VY67ENMY2T6S1WKT0T067 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-09T10:38:39.145" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:09.145" grpc.time_ms=1.054 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab # [ 425.752419] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:09.004Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a5f4f4dacbddcdf8225100e9","created_at":"2026-09-09T10:38:08.966Z","trace_propagation_headers":{"sentry-trace":"3a7ad008dbaa4c7abc136e42d990bdee-5ffd35689ae14aab","baggage":"sentry-trace_id=3a7ad008dbaa4c7abc136e42d990bdee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VY67ENMY2T6S1WKT0T067","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.970Z","job_size_bytes":65,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a5f4f4dacbddcdf8225100e9: start","job_status":"start","queue_duration_s":0.034234,"scheduling_latency_s":0.034253}2104gitlab # [ 425.769192] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:09.066Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a5f4f4dacbddcdf8225100e9","created_at":"2026-09-09T10:38:08.966Z","trace_propagation_headers":{"sentry-trace":"3a7ad008dbaa4c7abc136e42d990bdee-5ffd35689ae14aab","baggage":"sentry-trace_id=3a7ad008dbaa4c7abc136e42d990bdee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VY67ENMY2T6S1WKT0T067","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:08.970Z","job_size_bytes":65,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a5f4f4dacbddcdf8225100e9: done: 0.062522 sec","job_status":"done","queue_duration_s":0.034234,"scheduling_latency_s":0.034253,"redis_calls":10,"redis_duration_s":0.0022700000000000003,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001453,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000817,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.062522,"completed_at":"2026-09-09T10:38:09.066Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2105gitlab # [ 425.811498] gitaly[903]: time="2026-09-09T10:38:09.217Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY67ENMY2T6S1WKT0T067 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:39.215" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:09.215" grpc.time_ms=1.006 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 425.824321] nix-daemon[3707]: accepted connection from pid 4749, user nixbot2107gitlab # [ 425.825286] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:09.068Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"264518c2c441a3806460febc","created_at":"2026-09-09T10:38:09.025Z","trace_propagation_headers":{"sentry-trace":"3a7ad008dbaa4c7abc136e42d990bdee-5ffd35689ae14aab","baggage":"sentry-trace_id=3a7ad008dbaa4c7abc136e42d990bdee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VY67ENMY2T6S1WKT0T067","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:09.029Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-264518c2c441a3806460febc: start","job_status":"start","queue_duration_s":0.0391,"scheduling_latency_s":0.03912}2108gitlab # [ 425.841712] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:09.235Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"264518c2c441a3806460febc","created_at":"2026-09-09T10:38:09.025Z","trace_propagation_headers":{"sentry-trace":"3a7ad008dbaa4c7abc136e42d990bdee-5ffd35689ae14aab","baggage":"sentry-trace_id=3a7ad008dbaa4c7abc136e42d990bdee,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VY67ENMY2T6S1WKT0T067","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:09.029Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-264518c2c441a3806460febc: done: 0.167251 sec","job_status":"done","queue_duration_s":0.0391,"scheduling_latency_s":0.03912,"gitaly_calls":2,"gitaly_duration_s":0.007963,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007483,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001083,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001445,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000276,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001878,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000243,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.00057,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.125666,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13094584,"duration_s":0.167251,"completed_at":"2026-09-09T10:38:09.235Z","load_balancing_strategy":"primary","db_duration_s":0.035292,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2109gitlab # [ 425.891987] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:09.242Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"1a53ad2cc68f9bfcf0865e3d","created_at":"2026-09-09T10:38:09.127Z","trace_propagation_headers":{"sentry-trace":"3a7ad008dbaa4c7abc136e42d990bdee-81e0cfe3c268444a","baggage":"sentry-trace_id=3a7ad008dbaa4c7abc136e42d990bdee,sentry-release=Unknown"},"correlation_id":"01M22VY67ENMY2T6S1WKT0T067","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:09.130Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1a53ad2cc68f9bfcf0865e3d: start","job_status":"start","queue_duration_s":0.112048,"scheduling_latency_s":0.112081}2110gitlab # [ 425.907770] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:09.335Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"1a53ad2cc68f9bfcf0865e3d","created_at":"2026-09-09T10:38:09.127Z","trace_propagation_headers":{"sentry-trace":"3a7ad008dbaa4c7abc136e42d990bdee-81e0cfe3c268444a","baggage":"sentry-trace_id=3a7ad008dbaa4c7abc136e42d990bdee,sentry-release=Unknown"},"correlation_id":"01M22VY67ENMY2T6S1WKT0T067","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:09.130Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-1a53ad2cc68f9bfcf0865e3d: done: 0.093119 sec","job_status":"done","queue_duration_s":0.112048,"scheduling_latency_s":0.112081,"redis_calls":7,"redis_duration_s":0.002539,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001846,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000693,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.093119,"completed_at":"2026-09-09T10:38:09.335Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2111gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses2112gitlab # [ 426.287193] gitaly[903]: time="2026-09-09T10:38:10.106Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY7JV3ACBPJPD58NRTKW8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:40.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:10.104" grpc.time_ms=1.162 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses, in 0.24 seconds)2114gitlab # [ 426.346329] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1522115gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses2116gitlab # [ 427.491408] gitaly[903]: time="2026-09-09T10:38:11.309Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY8RJ51T5THKAQSQ159BY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:41.207" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:11.308" grpc.time_ms=1.23 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses, in 0.19 seconds)2118gitlab # [ 427.536502] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1352119gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses2120gitlab # [ 428.687166] gitaly[903]: time="2026-09-09T10:38:12.505Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VY9XS3D7ETNGVJP6B54PP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:42.102" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:12.503" grpc.time_ms=1.29 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses, in 0.20 seconds)2122gitlab # [ 428.734329] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1422123gitlab # [ 428.881149] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:12.698Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8941ead1e8a6e31ff0b3ff15","created_at":"2026-09-09T10:38:12.676Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b198fd3526e1f25c38116626c9392f2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:38:12.694Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8941ead1e8a6e31ff0b3ff15: start","job_status":"start","queue_duration_s":0.003732,"scheduling_latency_s":0.003797}2124gitlab # [ 428.993734] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:12.812Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2125gitlab # [ 429.030645] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:12.848Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8941ead1e8a6e31ff0b3ff15","created_at":"2026-09-09T10:38:12.676Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b198fd3526e1f25c38116626c9392f2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-09T10:38:12.694Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8941ead1e8a6e31ff0b3ff15: done: 0.15031 sec","job_status":"done","queue_duration_s":0.003732,"scheduling_latency_s":0.003797,"redis_calls":9,"redis_duration_s":0.020447,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002319,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004431,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034563,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.15031,"completed_at":"2026-09-09T10:38:12.848Z","load_balancing_strategy":"primary","db_duration_s":0.001159,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2126gitlab # [ 429.116931] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:12.853Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"757aa8912b608548afb2e07b","created_at":"2026-09-09T10:38:12.727Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6143798036ee96d337de894b9854891","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:12.751Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-757aa8912b608548afb2e07b: start","job_status":"start","queue_duration_s":0.101754,"scheduling_latency_s":0.101805}2127gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses2128gitlab # [ 429.894928] gitaly[903]: time="2026-09-09T10:38:13.712Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYB3BVXKYQHCW3D0M5SV5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:43.510" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:13.711" grpc.time_ms=1.145 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses, in 0.22 seconds)2130gitlab # [ 429.952765] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1592131gitlab # [ 430.408983] nix-daemon[3707]: accepted connection from pid 4787, user nixbot2132gitlab # [ 430.424498] nix-daemon[3707]: accepted connection from pid 4749, user nixbot2133gitlab # [ 430.658972] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.475Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"757aa8912b608548afb2e07b","created_at":"2026-09-09T10:38:12.727Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6143798036ee96d337de894b9854891","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:12.751Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-757aa8912b608548afb2e07b: done: 1.622859 sec","job_status":"done","queue_duration_s":0.101754,"scheduling_latency_s":0.101805,"redis_calls":564,"redis_duration_s":1.013928,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004782,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":1.006024,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.704099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.622859,"completed_at":"2026-09-09T10:38:14.475Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2134gitlab # [ 430.735564] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.478Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b140fd27c709f9bd04fad06d","created_at":"2026-09-09T10:38:12.768Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4fc9e4f37c1cd8e00e911d34ed9e503","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:12.800Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b140fd27c709f9bd04fad06d: start","job_status":"start","queue_duration_s":1.677776,"scheduling_latency_s":1.677802}2135gitlab # [ 430.752054] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.503Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b140fd27c709f9bd04fad06d","created_at":"2026-09-09T10:38:12.768Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4fc9e4f37c1cd8e00e911d34ed9e503","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:12.800Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b140fd27c709f9bd04fad06d: done: 0.025449 sec","job_status":"done","queue_duration_s":1.677776,"scheduling_latency_s":1.677802,"redis_calls":11,"redis_duration_s":0.0027800000000000004,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001115,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001201,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025449,"completed_at":"2026-09-09T10:38:14.503Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2136gitlab # [ 430.795493] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.505Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"aab1a5f35cbe49f5493c0c89","created_at":"2026-09-09T10:38:12.823Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff971aa847b5ab8f07e87fa7a3db0fb2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:12.889Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-aab1a5f35cbe49f5493c0c89: start","job_status":"start","queue_duration_s":1.616347,"scheduling_latency_s":1.616367}2137gitlab # [ 430.834900] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"aab1a5f35cbe49f5493c0c89","created_at":"2026-09-09T10:38:12.823Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff971aa847b5ab8f07e87fa7a3db0fb2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:12.889Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-aab1a5f35cbe49f5493c0c89: done: 0.039452 sec","job_status":"done","queue_duration_s":1.616347,"scheduling_latency_s":1.616367,"redis_calls":18,"redis_duration_s":0.004911,"redis_read_bytes":20,"redis_write_bytes":4702,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001044,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000404,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00263,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000833,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039452,"completed_at":"2026-09-09T10:38:14.544Z","load_balancing_strategy":"primary","db_duration_s":0.003529,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2138gitlab # [ 430.905136] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1ca824a346721341b44e419c","created_at":"2026-09-09T10:38:12.917Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d714278031a92ced2332804c562fba2a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:12.938Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1ca824a346721341b44e419c: start","job_status":"start","queue_duration_s":1.607851,"scheduling_latency_s":1.607869}2139gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses2140gitlab # [ 430.947317] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.617Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1ca824a346721341b44e419c","created_at":"2026-09-09T10:38:12.917Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d714278031a92ced2332804c562fba2a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:12.938Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1ca824a346721341b44e419c: done: 0.071079 sec","job_status":"done","queue_duration_s":1.607851,"scheduling_latency_s":1.607869,"redis_calls":11,"redis_duration_s":0.003084,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000475,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001339,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007871,"exclusive_lock_hold_duration_s":0.03801088,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.071079,"completed_at":"2026-09-09T10:38:14.617Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024115,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2141gitlab # [ 431.028897] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d7c8b64533813a04941767d8","created_at":"2026-09-09T10:38:12.961Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cd172537be412e78c8fc956aa2256e0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:12.984Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d7c8b64533813a04941767d8: start","job_status":"start","queue_duration_s":1.636056,"scheduling_latency_s":1.636074}2142gitlab # [ 431.069260] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.633Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2143gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses, in 0.16 seconds)2144gitlab # [ 431.076669] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.642Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d7c8b64533813a04941767d8","created_at":"2026-09-09T10:38:12.961Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cd172537be412e78c8fc956aa2256e0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:12.984Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d7c8b64533813a04941767d8: done: 0.021984 sec","job_status":"done","queue_duration_s":1.636056,"scheduling_latency_s":1.636074,"redis_calls":9,"redis_duration_s":0.002692,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000574,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021984,"completed_at":"2026-09-09T10:38:14.642Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2145gitlab # [ 431.135912] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ff950f70324b1dcd26cf4dcb","created_at":"2026-09-09T10:38:13.024Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc366095f575fa7d547f4029e1586dcc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.043Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ff950f70324b1dcd26cf4dcb: start","job_status":"start","queue_duration_s":1.600659,"scheduling_latency_s":1.600676}2146gitlab # [ 431.153620] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.656Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2147gitlab # [ 431.157586] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.664Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ff950f70324b1dcd26cf4dcb","created_at":"2026-09-09T10:38:13.024Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc366095f575fa7d547f4029e1586dcc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.043Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ff950f70324b1dcd26cf4dcb: done: 0.02032 sec","job_status":"done","queue_duration_s":1.600659,"scheduling_latency_s":1.600676,"redis_calls":9,"redis_duration_s":0.002315,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000637,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001202,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02032,"completed_at":"2026-09-09T10:38:14.664Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000655,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2148gitlab # [ 431.204407] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:14 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 962149gitlab # [ 431.207526] gitaly[903]: time="2026-09-09T10:38:14.904Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYC9HH6D04D23S29FK4VJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:44.702" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:14.903" grpc.time_ms=1.15 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2150gitlab # [ 431.220871] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.665Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"efc9f76fc74cc86e2b82b6a7","created_at":"2026-09-09T10:38:13.062Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d4ba27a853aa60b1dd026f9ace39631","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.090Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-efc9f76fc74cc86e2b82b6a7: start","job_status":"start","queue_duration_s":1.575321,"scheduling_latency_s":1.575337}2151gitlab # [ 431.235131] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.677Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2152gitlab # [ 431.238527] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.685Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"efc9f76fc74cc86e2b82b6a7","created_at":"2026-09-09T10:38:13.062Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d4ba27a853aa60b1dd026f9ace39631","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.090Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-efc9f76fc74cc86e2b82b6a7: done: 0.019865 sec","job_status":"done","queue_duration_s":1.575321,"scheduling_latency_s":1.575337,"redis_calls":9,"redis_duration_s":0.0022389999999999997,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000525,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001249,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000465,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019865,"completed_at":"2026-09-09T10:38:14.685Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2153gitlab # [ 431.279878] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.686Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"58a1e8c4adadb98b640766f8","created_at":"2026-09-09T10:38:13.124Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28f025a1c9da461fc88d0c95da7c878f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.145Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-58a1e8c4adadb98b640766f8: start","job_status":"start","queue_duration_s":1.541023,"scheduling_latency_s":1.541039}2154gitlab # [ 431.293878] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"58a1e8c4adadb98b640766f8","created_at":"2026-09-09T10:38:13.124Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28f025a1c9da461fc88d0c95da7c878f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.145Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-58a1e8c4adadb98b640766f8: done: 0.020028 sec","job_status":"done","queue_duration_s":1.541023,"scheduling_latency_s":1.541039,"redis_calls":9,"redis_duration_s":0.002137,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000487,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001178,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000472,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020028,"completed_at":"2026-09-09T10:38:14.706Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000588,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2155gitlab # [ 431.334645] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.708Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"27108aceaf3a63db0f0f9ad2","created_at":"2026-09-09T10:38:13.216Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"410a6a870f90d48e1df9769457f66796","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.237Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-27108aceaf3a63db0f0f9ad2: start","job_status":"start","queue_duration_s":1.470332,"scheduling_latency_s":1.470348}2156gitlab # [ 431.347624] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.728Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"27108aceaf3a63db0f0f9ad2","created_at":"2026-09-09T10:38:13.216Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"410a6a870f90d48e1df9769457f66796","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.237Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-27108aceaf3a63db0f0f9ad2: done: 0.02035 sec","job_status":"done","queue_duration_s":1.470332,"scheduling_latency_s":1.470348,"redis_calls":11,"redis_duration_s":0.002743,"redis_read_bytes":8,"redis_write_bytes":1094,"redis_cache_calls":2,"redis_cache_duration_s":0.000469,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000522,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000497,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02035,"completed_at":"2026-09-09T10:38:14.728Z","load_balancing_strategy":"primary","db_duration_s":0.000731,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2157gitlab # [ 431.388248] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.730Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"79af7548400b5b9058d43096","created_at":"2026-09-09T10:38:13.258Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"258d54945179f424ec1b97e7cece776e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.279Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-79af7548400b5b9058d43096: start","job_status":"start","queue_duration_s":1.450224,"scheduling_latency_s":1.450241}2158gitlab # [ 431.403001] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.756Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"79af7548400b5b9058d43096","created_at":"2026-09-09T10:38:13.258Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"258d54945179f424ec1b97e7cece776e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.279Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-79af7548400b5b9058d43096: done: 0.025908 sec","job_status":"done","queue_duration_s":1.450224,"scheduling_latency_s":1.450241,"redis_calls":11,"redis_duration_s":0.00332,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001573,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001187,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005729,"exclusive_lock_hold_duration_s":0.00357748,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.025908,"completed_at":"2026-09-09T10:38:14.755Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2159gitlab # [ 431.444806] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.757Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0e340c5473e7ee582e72165c","created_at":"2026-09-09T10:38:13.339Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.359Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0e340c5473e7ee582e72165c: start","job_status":"start","queue_duration_s":1.39812,"scheduling_latency_s":1.398135}2160gitlab # [ 431.457851] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0e340c5473e7ee582e72165c","created_at":"2026-09-09T10:38:13.339Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.359Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0e340c5473e7ee582e72165c: done: 0.117108 sec","job_status":"done","queue_duration_s":1.39812,"scheduling_latency_s":1.398135,"redis_calls":70,"redis_duration_s":0.017176,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002612,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000474,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013501,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000589,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.117108,"completed_at":"2026-09-09T10:38:14.874Z","load_balancing_strategy":"primary","db_duration_s":0.003249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2161gitlab # [ 431.500281] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.875Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"66153dfeaef3ec55885a88d2","created_at":"2026-09-09T10:38:13.378Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"afddb7bdbbae11a6e8a6b00aa058e1ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.401Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-66153dfeaef3ec55885a88d2: start","job_status":"start","queue_duration_s":1.47421,"scheduling_latency_s":1.474228}2162gitlab # [ 431.514995] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.889Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2163gitlab # [ 431.518941] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.900Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"66153dfeaef3ec55885a88d2","created_at":"2026-09-09T10:38:13.378Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"afddb7bdbbae11a6e8a6b00aa058e1ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.401Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-66153dfeaef3ec55885a88d2: done: 0.025003 sec","job_status":"done","queue_duration_s":1.47421,"scheduling_latency_s":1.474228,"redis_calls":9,"redis_duration_s":0.002055,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000877,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000324,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025003,"completed_at":"2026-09-09T10:38:14.900Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001438,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2164gitlab # [ 431.561407] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.903Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"0caed9090b3516e8d33cf24c","created_at":"2026-09-09T10:38:13.426Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0fcba98245712071ff861bf2c33bdf89","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.447Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-0caed9090b3516e8d33cf24c: start","job_status":"start","queue_duration_s":1.455836,"scheduling_latency_s":1.455859}2165gitlab # [ 431.575777] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.937Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"0caed9090b3516e8d33cf24c","created_at":"2026-09-09T10:38:13.426Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0fcba98245712071ff861bf2c33bdf89","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.447Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-0caed9090b3516e8d33cf24c: done: 0.033464 sec","job_status":"done","queue_duration_s":1.455836,"scheduling_latency_s":1.455859,"redis_calls":9,"redis_duration_s":0.001679,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000337,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000379,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033464,"completed_at":"2026-09-09T10:38:14.937Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003445,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2166gitlab # [ 431.618881] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.938Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"dd0c00643d0a46fa67e67ed0","created_at":"2026-09-09T10:38:13.467Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fcf782ed84352f0cdfef1e35da8662b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.494Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-dd0c00643d0a46fa67e67ed0: start","job_status":"start","queue_duration_s":1.444438,"scheduling_latency_s":1.444461}2167gitlab # [ 431.633641] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.973Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"dd0c00643d0a46fa67e67ed0","created_at":"2026-09-09T10:38:13.467Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fcf782ed84352f0cdfef1e35da8662b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.494Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-dd0c00643d0a46fa67e67ed0: done: 0.034898 sec","job_status":"done","queue_duration_s":1.444438,"scheduling_latency_s":1.444461,"redis_calls":12,"redis_duration_s":0.00267,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000375,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00156,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000735,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00961058,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.034898,"completed_at":"2026-09-09T10:38:14.973Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002668,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2168gitlab # [ 431.678291] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:14.975Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"73f60c6ff547513cd3b8cd1e","created_at":"2026-09-09T10:38:13.526Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c29436f7b449ba4c973479f39fd6f925","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.547Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-73f60c6ff547513cd3b8cd1e: start","job_status":"start","queue_duration_s":1.42784,"scheduling_latency_s":1.427857}2169gitlab # [ 431.692169] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.005Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"73f60c6ff547513cd3b8cd1e","created_at":"2026-09-09T10:38:13.526Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c29436f7b449ba4c973479f39fd6f925","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.547Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-73f60c6ff547513cd3b8cd1e: done: 0.030621 sec","job_status":"done","queue_duration_s":1.42784,"scheduling_latency_s":1.427857,"redis_calls":11,"redis_duration_s":0.003579,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000545,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001252,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005517,"exclusive_lock_hold_duration_s":0.00833926,"duration_s":0.030621,"completed_at":"2026-09-09T10:38:15.005Z","load_balancing_strategy":"primary","db_duration_s":0.005146,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2170gitlab # [ 431.732646] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.007Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"eae0b79524b6af36bd4992b6","created_at":"2026-09-09T10:38:13.755Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df4bc96dce293e1c9399f62ee4a7970a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.785Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-eae0b79524b6af36bd4992b6: start","job_status":"start","queue_duration_s":1.222311,"scheduling_latency_s":1.222329}2171gitlab # [ 431.746426] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.305Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"eae0b79524b6af36bd4992b6","created_at":"2026-09-09T10:38:13.755Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df4bc96dce293e1c9399f62ee4a7970a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.785Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-eae0b79524b6af36bd4992b6: done: 0.298112 sec","job_status":"done","queue_duration_s":1.222311,"scheduling_latency_s":1.222329,"redis_calls":13,"redis_duration_s":0.003767,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001056,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001413,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001298,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.222897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058874,"exclusive_lock_hold_duration_s":0.26280852,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.298112,"completed_at":"2026-09-09T10:38:15.305Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.080289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2172gitlab # [ 431.789795] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.309Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"70b993c6cd9108e2e72029a8","created_at":"2026-09-09T10:38:13.838Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6cce95fec27212b19b16c2e9242b201","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.858Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-70b993c6cd9108e2e72029a8: start","job_status":"start","queue_duration_s":1.451095,"scheduling_latency_s":1.451128}2173gitlab # [ 431.803601] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.379Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"70b993c6cd9108e2e72029a8","created_at":"2026-09-09T10:38:13.838Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6cce95fec27212b19b16c2e9242b201","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.858Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-70b993c6cd9108e2e72029a8: done: 0.069846 sec","job_status":"done","queue_duration_s":1.451095,"scheduling_latency_s":1.451128,"redis_calls":9,"redis_duration_s":0.005195,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001021,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00335,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000824,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.069846,"completed_at":"2026-09-09T10:38:15.379Z","load_balancing_strategy":"primary","db_duration_s":0.019696,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2174gitlab # [ 431.846786] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.383Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"feb553fd9a556a256b3bb5a6","created_at":"2026-09-09T10:38:13.879Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1f675e313ea46fb94971c53da3c5342","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.899Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-feb553fd9a556a256b3bb5a6: start","job_status":"start","queue_duration_s":1.484204,"scheduling_latency_s":1.484241}2175gitlab # [ 431.888536] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.428Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"feb553fd9a556a256b3bb5a6","created_at":"2026-09-09T10:38:13.879Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1f675e313ea46fb94971c53da3c5342","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.899Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-feb553fd9a556a256b3bb5a6: done: 0.045012 sec","job_status":"done","queue_duration_s":1.484204,"scheduling_latency_s":1.484241,"redis_calls":9,"redis_duration_s":0.003231,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00068,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001792,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000759,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045012,"completed_at":"2026-09-09T10:38:15.428Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2176gitlab # [ 431.963083] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.430Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"eaee645266b45f7b30d89d90","created_at":"2026-09-09T10:38:13.921Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3b7674f2efe059eefd6421a52745bae","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.945Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-eaee645266b45f7b30d89d90: start","job_status":"start","queue_duration_s":1.485447,"scheduling_latency_s":1.485475}2177gitlab # [ 431.981612] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.472Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"eaee645266b45f7b30d89d90","created_at":"2026-09-09T10:38:13.921Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3b7674f2efe059eefd6421a52745bae","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.945Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-eaee645266b45f7b30d89d90: done: 0.042259 sec","job_status":"done","queue_duration_s":1.485447,"scheduling_latency_s":1.485475,"redis_calls":9,"redis_duration_s":0.0039380000000000005,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000637,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042259,"completed_at":"2026-09-09T10:38:15.472Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2178gitlab # [ 432.027421] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.475Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"9383ea3215f85629049fcc9e","created_at":"2026-09-09T10:38:13.971Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff826c2fa2e3357c63be60646b549bad","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.992Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-9383ea3215f85629049fcc9e: start","job_status":"start","queue_duration_s":1.48247,"scheduling_latency_s":1.482499}2179gitlab # [ 432.042653] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.510Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"9383ea3215f85629049fcc9e","created_at":"2026-09-09T10:38:13.971Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff826c2fa2e3357c63be60646b549bad","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:13.992Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-9383ea3215f85629049fcc9e: done: 0.035423 sec","job_status":"done","queue_duration_s":1.48247,"scheduling_latency_s":1.482499,"redis_calls":11,"redis_duration_s":0.003307,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000576,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001405,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001326,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006944,"exclusive_lock_hold_duration_s":0.00686248,"duration_s":0.035423,"completed_at":"2026-09-09T10:38:15.510Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2180gitlab # [ 432.085136] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.512Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3156acd4e747cf55f4297f45","created_at":"2026-09-09T10:38:14.015Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddd819a8880561d90958bd2ba0c12e11","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.037Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3156acd4e747cf55f4297f45: start","job_status":"start","queue_duration_s":1.475056,"scheduling_latency_s":1.475078}2181gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses2182gitlab # [ 432.099691] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3156acd4e747cf55f4297f45","created_at":"2026-09-09T10:38:14.015Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddd819a8880561d90958bd2ba0c12e11","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.037Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3156acd4e747cf55f4297f45: done: 0.068839 sec","job_status":"done","queue_duration_s":1.475056,"scheduling_latency_s":1.475078,"redis_calls":13,"redis_duration_s":0.003748,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001099,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001404,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001245,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00066842,"exclusive_lock_hold_duration_s":0.03682972,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.068839,"completed_at":"2026-09-09T10:38:15.581Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2183gitlab # [ 432.142371] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"da482dbbfafdb83a4ed1b58b","created_at":"2026-09-09T10:38:14.063Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d812260fc0170dbab0a4457af23fcf47","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:38:14.085Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-da482dbbfafdb83a4ed1b58b: start","job_status":"start","queue_duration_s":1.498509,"scheduling_latency_s":1.498531}2184gitlab # [ 432.154863] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.599Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2185gitlab # [ 432.158650] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.609Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"da482dbbfafdb83a4ed1b58b","created_at":"2026-09-09T10:38:14.063Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d812260fc0170dbab0a4457af23fcf47","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-09T10:38:14.085Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-da482dbbfafdb83a4ed1b58b: done: 0.025321 sec","job_status":"done","queue_duration_s":1.498509,"scheduling_latency_s":1.498531,"redis_calls":9,"redis_duration_s":0.002362,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000543,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001316,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025321,"completed_at":"2026-09-09T10:38:15.609Z","load_balancing_strategy":"primary","db_duration_s":0.000658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2186gitlab # [ 432.199449] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fe160d2c38b0c3f60cfb95a9","created_at":"2026-09-09T10:38:14.137Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e723aa0d480e1c4415e658f231f03076","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:38:14.163Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fe160d2c38b0c3f60cfb95a9: start","job_status":"start","queue_duration_s":1.44714,"scheduling_latency_s":1.447158}2187gitlab # [ 432.213384] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.651Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fe160d2c38b0c3f60cfb95a9","created_at":"2026-09-09T10:38:14.137Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-14ca814f302c4adb","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e723aa0d480e1c4415e658f231f03076","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-09T10:38:14.163Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fe160d2c38b0c3f60cfb95a9: done: 0.040597 sec","job_status":"done","queue_duration_s":1.44714,"scheduling_latency_s":1.447158,"redis_calls":9,"redis_duration_s":0.00313,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00053,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001587,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040597,"completed_at":"2026-09-09T10:38:15.651Z","load_balancing_strategy":"primary","db_duration_s":0.006491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2188gitlab # [ 432.253913] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.653Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b9296716e4ca6fae9cda8e74","created_at":"2026-09-09T10:38:14.522Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-7261ec4faa6d4faf","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ff971aa847b5ab8f07e87fa7a3db0fb2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.536Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b9296716e4ca6fae9cda8e74: start","job_status":"start","queue_duration_s":1.116865,"scheduling_latency_s":1.116882}2189gitlab # [ 432.266154] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.673Z","message":"No existing merge request to be cleaned up."}2190gitlab # [ 432.267779] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.691Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b9296716e4ca6fae9cda8e74","created_at":"2026-09-09T10:38:14.522Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-7261ec4faa6d4faf","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ff971aa847b5ab8f07e87fa7a3db0fb2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.536Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b9296716e4ca6fae9cda8e74: done: 0.03731 sec","job_status":"done","queue_duration_s":1.116865,"scheduling_latency_s":1.116882,"redis_calls":12,"redis_duration_s":0.003209,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000598,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001546,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03731,"completed_at":"2026-09-09T10:38:15.690Z","load_balancing_strategy":"primary","db_duration_s":0.005482,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2191gitlab # [ 432.307717] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.692Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7325a3249667747b48f9cf31","created_at":"2026-09-09T10:38:14.522Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-7261ec4faa6d4faf","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ff971aa847b5ab8f07e87fa7a3db0fb2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.536Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7325a3249667747b48f9cf31: start","job_status":"start","queue_duration_s":1.155555,"scheduling_latency_s":1.15557}2192gitlab # [ 432.319855] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.704Z","message":"No existing merge request to be cleaned up."}2193gitlab # [ 432.321651] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.714Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7325a3249667747b48f9cf31","created_at":"2026-09-09T10:38:14.522Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-7261ec4faa6d4faf","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ff971aa847b5ab8f07e87fa7a3db0fb2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.536Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7325a3249667747b48f9cf31: done: 0.021825 sec","job_status":"done","queue_duration_s":1.155555,"scheduling_latency_s":1.15557,"redis_calls":10,"redis_duration_s":0.002541,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001081,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00146,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021825,"completed_at":"2026-09-09T10:38:15.714Z","load_balancing_strategy":"primary","db_duration_s":0.002529,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2194gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses, in 0.25 seconds)2195gitlab # [ 432.359242] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.715Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aaa44c20b08bfa304ac6579b","created_at":"2026-09-09T10:38:14.522Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-7261ec4faa6d4faf","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ff971aa847b5ab8f07e87fa7a3db0fb2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.536Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aaa44c20b08bfa304ac6579b: start","job_status":"start","queue_duration_s":1.178751,"scheduling_latency_s":1.178766}2196gitlab # [ 432.371346] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.727Z","message":"No existing merge request to be cleaned up."}2197gitlab # [ 432.373398] gitaly[903]: time="2026-09-09T10:38:16.123Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYDETEPGKTPGTXR7XY2V9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:46.021" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:16.122" grpc.time_ms=1.106 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2198gitlab # [ 432.386278] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1502199gitlab # [ 432.388947] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.737Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aaa44c20b08bfa304ac6579b","created_at":"2026-09-09T10:38:14.522Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-7261ec4faa6d4faf","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ff971aa847b5ab8f07e87fa7a3db0fb2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.536Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aaa44c20b08bfa304ac6579b: done: 0.022354 sec","job_status":"done","queue_duration_s":1.178751,"scheduling_latency_s":1.178766,"redis_calls":10,"redis_duration_s":0.002692,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001212,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00148,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022354,"completed_at":"2026-09-09T10:38:15.737Z","load_balancing_strategy":"primary","db_duration_s":0.002508,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2200gitlab # [ 432.427675] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.740Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aab4970d70ed72bcc1bc9e7d","created_at":"2026-09-09T10:38:14.522Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-7261ec4faa6d4faf","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ff971aa847b5ab8f07e87fa7a3db0fb2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.536Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aab4970d70ed72bcc1bc9e7d: start","job_status":"start","queue_duration_s":1.203134,"scheduling_latency_s":1.203152}2201gitlab # [ 432.439685] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.752Z","message":"No existing merge request to be cleaned up."}2202gitlab # [ 432.441465] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.761Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"aab4970d70ed72bcc1bc9e7d","created_at":"2026-09-09T10:38:14.522Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-7261ec4faa6d4faf","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ff971aa847b5ab8f07e87fa7a3db0fb2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.536Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-aab4970d70ed72bcc1bc9e7d: done: 0.021237 sec","job_status":"done","queue_duration_s":1.203134,"scheduling_latency_s":1.203152,"redis_calls":10,"redis_duration_s":0.00261,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001588,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021237,"completed_at":"2026-09-09T10:38:15.761Z","load_balancing_strategy":"primary","db_duration_s":0.002488,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2203gitlab # [ 432.479510] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df5efdbf9e980a89495f7db3","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df5efdbf9e980a89495f7db3: start","job_status":"start","queue_duration_s":0.897607,"scheduling_latency_s":0.897624}2204gitlab # [ 432.491808] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df5efdbf9e980a89495f7db3","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df5efdbf9e980a89495f7db3: done: 0.035932 sec","job_status":"done","queue_duration_s":0.897607,"scheduling_latency_s":0.897624,"redis_calls":15,"redis_duration_s":0.003824,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00059,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035932,"completed_at":"2026-09-09T10:38:15.799Z","load_balancing_strategy":"primary","db_duration_s":0.000659,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2205gitlab # [ 432.532164] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"938c679a8b064e62166a5423","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-938c679a8b064e62166a5423: start","job_status":"start","queue_duration_s":0.936107,"scheduling_latency_s":0.936145}2206gitlab # [ 432.544079] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"938c679a8b064e62166a5423","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-938c679a8b064e62166a5423: done: 0.035152 sec","job_status":"done","queue_duration_s":0.936107,"scheduling_latency_s":0.936145,"redis_calls":13,"redis_duration_s":0.002979,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001041,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035152,"completed_at":"2026-09-09T10:38:15.836Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2207gitlab # [ 432.582820] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15ee965da44519a4870ff10a","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15ee965da44519a4870ff10a: start","job_status":"start","queue_duration_s":0.974235,"scheduling_latency_s":0.974272}2208gitlab # [ 432.594948] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15ee965da44519a4870ff10a","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15ee965da44519a4870ff10a: done: 0.031865 sec","job_status":"done","queue_duration_s":0.974235,"scheduling_latency_s":0.974272,"redis_calls":13,"redis_duration_s":0.003548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001211,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002337,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031865,"completed_at":"2026-09-09T10:38:15.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2209gitlab # [ 432.634539] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe11a590ea3830afb487f281","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe11a590ea3830afb487f281: start","job_status":"start","queue_duration_s":1.008848,"scheduling_latency_s":1.008875}2210gitlab # [ 432.646656] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe11a590ea3830afb487f281","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe11a590ea3830afb487f281: done: 0.027172 sec","job_status":"done","queue_duration_s":1.008848,"scheduling_latency_s":1.008875,"redis_calls":13,"redis_duration_s":0.0033539999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027172,"completed_at":"2026-09-09T10:38:15.901Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2211gitlab # [ 432.685577] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51b3e509fa986aeecc7e18b9","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51b3e509fa986aeecc7e18b9: start","job_status":"start","queue_duration_s":1.038532,"scheduling_latency_s":1.038558}2212gitlab # [ 432.697647] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51b3e509fa986aeecc7e18b9","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51b3e509fa986aeecc7e18b9: done: 0.022742 sec","job_status":"done","queue_duration_s":1.038532,"scheduling_latency_s":1.038558,"redis_calls":13,"redis_duration_s":0.0030080000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000995,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022742,"completed_at":"2026-09-09T10:38:15.926Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2213gitlab # [ 432.736332] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53783a39901d1b4abcfffd7d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53783a39901d1b4abcfffd7d: start","job_status":"start","queue_duration_s":1.063174,"scheduling_latency_s":1.063195}2214gitlab # [ 432.748333] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53783a39901d1b4abcfffd7d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53783a39901d1b4abcfffd7d: done: 0.019072 sec","job_status":"done","queue_duration_s":1.063174,"scheduling_latency_s":1.063195,"redis_calls":13,"redis_duration_s":0.0028970000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001196,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001701,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019072,"completed_at":"2026-09-09T10:38:15.947Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2215gitlab # [ 432.786770] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecedff05c0cd71686a1ee422","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecedff05c0cd71686a1ee422: start","job_status":"start","queue_duration_s":1.08404,"scheduling_latency_s":1.084059}2216gitlab # [ 432.799315] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecedff05c0cd71686a1ee422","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecedff05c0cd71686a1ee422: done: 0.018452 sec","job_status":"done","queue_duration_s":1.08404,"scheduling_latency_s":1.084059,"redis_calls":13,"redis_duration_s":0.0029560000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001023,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018452,"completed_at":"2026-09-09T10:38:15.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2217gitlab # [ 432.839252] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f2ef46b23b14b92e8f4ad82","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f2ef46b23b14b92e8f4ad82: start","job_status":"start","queue_duration_s":1.103981,"scheduling_latency_s":1.103999}2218gitlab # [ 432.851509] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f2ef46b23b14b92e8f4ad82","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f2ef46b23b14b92e8f4ad82: done: 0.018678 sec","job_status":"done","queue_duration_s":1.103981,"scheduling_latency_s":1.103999,"redis_calls":13,"redis_duration_s":0.002075,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000813,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001262,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018678,"completed_at":"2026-09-09T10:38:15.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2219gitlab # [ 432.890104] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:15.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05eefb3f39030c310fc6155d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05eefb3f39030c310fc6155d: start","job_status":"start","queue_duration_s":1.123999,"scheduling_latency_s":1.124016}2220gitlab # [ 432.902354] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05eefb3f39030c310fc6155d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05eefb3f39030c310fc6155d: done: 0.01734 sec","job_status":"done","queue_duration_s":1.123999,"scheduling_latency_s":1.124016,"redis_calls":13,"redis_duration_s":0.0016950000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01734,"completed_at":"2026-09-09T10:38:16.006Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2221gitlab # [ 432.940791] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24e69cda12b003ab31345b86","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24e69cda12b003ab31345b86: start","job_status":"start","queue_duration_s":1.14241,"scheduling_latency_s":1.142427}2222gitlab # [ 432.953038] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24e69cda12b003ab31345b86","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24e69cda12b003ab31345b86: done: 0.01662 sec","job_status":"done","queue_duration_s":1.14241,"scheduling_latency_s":1.142427,"redis_calls":13,"redis_duration_s":0.001637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00064,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01662,"completed_at":"2026-09-09T10:38:16.024Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2223gitlab # [ 432.991442] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ce4ffa84814ead3b96b2528","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ce4ffa84814ead3b96b2528: start","job_status":"start","queue_duration_s":1.160105,"scheduling_latency_s":1.160121}2224gitlab # [ 433.003809] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ce4ffa84814ead3b96b2528","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ce4ffa84814ead3b96b2528: done: 0.014342 sec","job_status":"done","queue_duration_s":1.160105,"scheduling_latency_s":1.160121,"redis_calls":13,"redis_duration_s":0.001401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014342,"completed_at":"2026-09-09T10:38:16.039Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2225gitlab # [ 433.043125] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39c1bba900c2ff949f8f4cc1","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39c1bba900c2ff949f8f4cc1: start","job_status":"start","queue_duration_s":1.175504,"scheduling_latency_s":1.17552}2226gitlab # [ 433.055465] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39c1bba900c2ff949f8f4cc1","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39c1bba900c2ff949f8f4cc1: done: 0.015122 sec","job_status":"done","queue_duration_s":1.175504,"scheduling_latency_s":1.17552,"redis_calls":13,"redis_duration_s":0.001818,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015122,"completed_at":"2026-09-09T10:38:16.056Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2227gitlab # [ 433.093724] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff546c5f14d674887a71ef7d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff546c5f14d674887a71ef7d: start","job_status":"start","queue_duration_s":1.191693,"scheduling_latency_s":1.19171}2228gitlab # [ 433.105860] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff546c5f14d674887a71ef7d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff546c5f14d674887a71ef7d: done: 0.014217 sec","job_status":"done","queue_duration_s":1.191693,"scheduling_latency_s":1.19171,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014217,"completed_at":"2026-09-09T10:38:16.071Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2229gitlab # [ 433.144237] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e3468031180c7ebb62ac899","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e3468031180c7ebb62ac899: start","job_status":"start","queue_duration_s":1.206995,"scheduling_latency_s":1.207012}2230gitlab # [ 433.156066] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e3468031180c7ebb62ac899","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e3468031180c7ebb62ac899: done: 0.016898 sec","job_status":"done","queue_duration_s":1.206995,"scheduling_latency_s":1.207012,"redis_calls":13,"redis_duration_s":0.003941,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003004,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016898,"completed_at":"2026-09-09T10:38:16.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2231gitlab # [ 433.194219] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1a6385cb44f875b0974f50d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1a6385cb44f875b0974f50d: start","job_status":"start","queue_duration_s":1.225056,"scheduling_latency_s":1.225072}2232gitlab # [ 433.206314] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1a6385cb44f875b0974f50d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1a6385cb44f875b0974f50d: done: 0.01521 sec","job_status":"done","queue_duration_s":1.225056,"scheduling_latency_s":1.225072,"redis_calls":13,"redis_duration_s":0.0024980000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001588,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01521,"completed_at":"2026-09-09T10:38:16.105Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2233gitlab # [ 433.244866] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef8bef1106b7a07af3d3844d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef8bef1106b7a07af3d3844d: start","job_status":"start","queue_duration_s":1.241709,"scheduling_latency_s":1.241726}2234gitlab # [ 433.256849] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef8bef1106b7a07af3d3844d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef8bef1106b7a07af3d3844d: done: 0.015094 sec","job_status":"done","queue_duration_s":1.241709,"scheduling_latency_s":1.241726,"redis_calls":13,"redis_duration_s":0.002355,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001642,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015094,"completed_at":"2026-09-09T10:38:16.122Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2235gitlab # [ 433.294322] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8cd7c72419860dcb50f05d0","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8cd7c72419860dcb50f05d0: start","job_status":"start","queue_duration_s":1.258169,"scheduling_latency_s":1.258186}2236gitlab # [ 433.306186] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8cd7c72419860dcb50f05d0","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8cd7c72419860dcb50f05d0: done: 0.015266 sec","job_status":"done","queue_duration_s":1.258169,"scheduling_latency_s":1.258186,"redis_calls":13,"redis_duration_s":0.002405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000721,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001684,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015266,"completed_at":"2026-09-09T10:38:16.138Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2237gitlab # [ 433.343876] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e483e4bfd31540ccaf9b497","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e483e4bfd31540ccaf9b497: start","job_status":"start","queue_duration_s":1.274664,"scheduling_latency_s":1.274682}2238gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses2239gitlab # [ 433.355982] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e483e4bfd31540ccaf9b497","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e483e4bfd31540ccaf9b497: done: 0.014695 sec","job_status":"done","queue_duration_s":1.274664,"scheduling_latency_s":1.274682,"redis_calls":13,"redis_duration_s":0.001604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014695,"completed_at":"2026-09-09T10:38:16.154Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2240gitlab # [ 433.392326] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d110b259a12dbdcf2885019","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d110b259a12dbdcf2885019: start","job_status":"start","queue_duration_s":1.290442,"scheduling_latency_s":1.290459}2241gitlab # [ 433.403412] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d110b259a12dbdcf2885019","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d110b259a12dbdcf2885019: done: 0.014133 sec","job_status":"done","queue_duration_s":1.290442,"scheduling_latency_s":1.290459,"redis_calls":13,"redis_duration_s":0.0013679999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014133,"completed_at":"2026-09-09T10:38:16.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2242gitlab # [ 433.440817] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5bcfc7e9bb05525ea067431","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5bcfc7e9bb05525ea067431: start","job_status":"start","queue_duration_s":1.305693,"scheduling_latency_s":1.30571}2243gitlab # [ 433.453558] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5bcfc7e9bb05525ea067431","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5bcfc7e9bb05525ea067431: done: 0.014479 sec","job_status":"done","queue_duration_s":1.305693,"scheduling_latency_s":1.30571,"redis_calls":13,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014479,"completed_at":"2026-09-09T10:38:16.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2244gitlab # [ 433.491505] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"398989db6ccaa6d779e6c694","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-398989db6ccaa6d779e6c694: start","job_status":"start","queue_duration_s":1.321236,"scheduling_latency_s":1.321288}2245gitlab # [ 433.503622] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"398989db6ccaa6d779e6c694","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-398989db6ccaa6d779e6c694: done: 0.014303 sec","job_status":"done","queue_duration_s":1.321236,"scheduling_latency_s":1.321288,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014303,"completed_at":"2026-09-09T10:38:16.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2246gitlab # [ 433.541540] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85f86e2d902a9bdc8cb77c3b","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85f86e2d902a9bdc8cb77c3b: start","job_status":"start","queue_duration_s":1.33658,"scheduling_latency_s":1.336597}2247gitlab # [ 433.553381] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85f86e2d902a9bdc8cb77c3b","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85f86e2d902a9bdc8cb77c3b: done: 0.014359 sec","job_status":"done","queue_duration_s":1.33658,"scheduling_latency_s":1.336597,"redis_calls":13,"redis_duration_s":0.00143,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014359,"completed_at":"2026-09-09T10:38:16.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2248gitlab # [ 433.591145] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7e2f49010e0488ff533ac26","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7e2f49010e0488ff533ac26: start","job_status":"start","queue_duration_s":1.352026,"scheduling_latency_s":1.352044}2249gitlab # [ 433.603166] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7e2f49010e0488ff533ac26","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7e2f49010e0488ff533ac26: done: 0.015365 sec","job_status":"done","queue_duration_s":1.352026,"scheduling_latency_s":1.352044,"redis_calls":13,"redis_duration_s":0.002595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015365,"completed_at":"2026-09-09T10:38:16.232Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2250gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses, in 0.28 seconds)2251gitlab # [ 433.641137] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1154deb611b4ca716753536e","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1154deb611b4ca716753536e: start","job_status":"start","queue_duration_s":1.368815,"scheduling_latency_s":1.368831}2252gitlab # [ 433.652976] gitaly[903]: time="2026-09-09T10:38:17.397Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYEPCZ44S7B9KC2AK5BST grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:47.195" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:17.395" grpc.time_ms=1.158 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2253gitlab # [ 433.666762] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1572254gitlab # [ 433.669411] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1154deb611b4ca716753536e","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1154deb611b4ca716753536e: done: 0.014986 sec","job_status":"done","queue_duration_s":1.368815,"scheduling_latency_s":1.368831,"redis_calls":13,"redis_duration_s":0.0025440000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014986,"completed_at":"2026-09-09T10:38:16.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2255gitlab # [ 433.708436] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6b2e29b78b1d597d40bd0ff","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6b2e29b78b1d597d40bd0ff: start","job_status":"start","queue_duration_s":1.385161,"scheduling_latency_s":1.385178}2256gitlab # [ 433.720540] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6b2e29b78b1d597d40bd0ff","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6b2e29b78b1d597d40bd0ff: done: 0.015502 sec","job_status":"done","queue_duration_s":1.385161,"scheduling_latency_s":1.385178,"redis_calls":13,"redis_duration_s":0.0029319999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001026,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015502,"completed_at":"2026-09-09T10:38:16.266Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2257gitlab # [ 433.759298] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8363270b13c4cad9074661b","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8363270b13c4cad9074661b: start","job_status":"start","queue_duration_s":1.402015,"scheduling_latency_s":1.402031}2258gitlab # [ 433.771772] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8363270b13c4cad9074661b","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8363270b13c4cad9074661b: done: 0.014855 sec","job_status":"done","queue_duration_s":1.402015,"scheduling_latency_s":1.402031,"redis_calls":13,"redis_duration_s":0.002471,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001588,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014855,"completed_at":"2026-09-09T10:38:16.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2259gitlab # [ 433.810837] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5be6603f96405b6ddc47012d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5be6603f96405b6ddc47012d: start","job_status":"start","queue_duration_s":1.418226,"scheduling_latency_s":1.418242}2260gitlab # [ 433.823697] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5be6603f96405b6ddc47012d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5be6603f96405b6ddc47012d: done: 0.015051 sec","job_status":"done","queue_duration_s":1.418226,"scheduling_latency_s":1.418242,"redis_calls":13,"redis_duration_s":0.002703,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001751,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015051,"completed_at":"2026-09-09T10:38:16.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2261gitlab # [ 433.862469] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7b25944c8c2ff65a238d4c2","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7b25944c8c2ff65a238d4c2: start","job_status":"start","queue_duration_s":1.434599,"scheduling_latency_s":1.434615}2262gitlab # [ 433.875462] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7b25944c8c2ff65a238d4c2","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7b25944c8c2ff65a238d4c2: done: 0.014992 sec","job_status":"done","queue_duration_s":1.434599,"scheduling_latency_s":1.434615,"redis_calls":13,"redis_duration_s":0.002659,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001754,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014992,"completed_at":"2026-09-09T10:38:16.315Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2263gitlab # [ 433.914212] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48e6fcfec7c202780a5c9a0b","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48e6fcfec7c202780a5c9a0b: start","job_status":"start","queue_duration_s":1.451067,"scheduling_latency_s":1.451084}2264gitlab # [ 433.926714] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48e6fcfec7c202780a5c9a0b","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48e6fcfec7c202780a5c9a0b: done: 0.015205 sec","job_status":"done","queue_duration_s":1.451067,"scheduling_latency_s":1.451084,"redis_calls":13,"redis_duration_s":0.002735,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015205,"completed_at":"2026-09-09T10:38:16.331Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2265gitlab # [ 433.965605] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d475d3b3e548bf6520805f9d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d475d3b3e548bf6520805f9d: start","job_status":"start","queue_duration_s":1.467619,"scheduling_latency_s":1.467636}2266gitlab # [ 433.977753] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d475d3b3e548bf6520805f9d","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d475d3b3e548bf6520805f9d: done: 0.027027 sec","job_status":"done","queue_duration_s":1.467619,"scheduling_latency_s":1.467636,"redis_calls":13,"redis_duration_s":0.004819,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027027,"completed_at":"2026-09-09T10:38:16.360Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2267gitlab # [ 434.016570] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd9b80de607bbdf52b1ab7df","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd9b80de607bbdf52b1ab7df: start","job_status":"start","queue_duration_s":1.497528,"scheduling_latency_s":1.497568}2268gitlab # [ 434.029233] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd9b80de607bbdf52b1ab7df","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd9b80de607bbdf52b1ab7df: done: 0.038355 sec","job_status":"done","queue_duration_s":1.497528,"scheduling_latency_s":1.497568,"redis_calls":13,"redis_duration_s":0.00457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038355,"completed_at":"2026-09-09T10:38:16.401Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2269gitlab # [ 434.068092] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5430318bc8d02eec59f847e5","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5430318bc8d02eec59f847e5: start","job_status":"start","queue_duration_s":1.538466,"scheduling_latency_s":1.5385}2270gitlab # [ 434.081253] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5430318bc8d02eec59f847e5","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5430318bc8d02eec59f847e5: done: 0.034208 sec","job_status":"done","queue_duration_s":1.538466,"scheduling_latency_s":1.5385,"redis_calls":13,"redis_duration_s":0.004142,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001385,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002757,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034208,"completed_at":"2026-09-09T10:38:16.438Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2271gitlab # [ 434.119994] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c0578834c92ed72ec7349a1","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c0578834c92ed72ec7349a1: start","job_status":"start","queue_duration_s":1.575312,"scheduling_latency_s":1.575353}2272gitlab # [ 434.132008] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c0578834c92ed72ec7349a1","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c0578834c92ed72ec7349a1: done: 0.031694 sec","job_status":"done","queue_duration_s":1.575312,"scheduling_latency_s":1.575353,"redis_calls":13,"redis_duration_s":0.004251,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002728,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031694,"completed_at":"2026-09-09T10:38:16.472Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2273gitlab # [ 434.170320] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9189dbc65e8bfc63131128d0","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9189dbc65e8bfc63131128d0: start","job_status":"start","queue_duration_s":1.610637,"scheduling_latency_s":1.610681}2274gitlab # [ 434.182443] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9189dbc65e8bfc63131128d0","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9189dbc65e8bfc63131128d0: done: 0.037385 sec","job_status":"done","queue_duration_s":1.610637,"scheduling_latency_s":1.610681,"redis_calls":13,"redis_duration_s":0.00432,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002751,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037385,"completed_at":"2026-09-09T10:38:16.513Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2275gitlab # [ 434.220627] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd2b7be2f9f3e8ae9ea551b3","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd2b7be2f9f3e8ae9ea551b3: start","job_status":"start","queue_duration_s":1.650355,"scheduling_latency_s":1.650385}2276gitlab # [ 434.232653] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd2b7be2f9f3e8ae9ea551b3","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd2b7be2f9f3e8ae9ea551b3: done: 0.025985 sec","job_status":"done","queue_duration_s":1.650355,"scheduling_latency_s":1.650385,"redis_calls":13,"redis_duration_s":0.0034720000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001178,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002294,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025985,"completed_at":"2026-09-09T10:38:16.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2277gitlab # [ 434.270937] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc6dfbd2e551deb99dfe1293","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc6dfbd2e551deb99dfe1293: start","job_status":"start","queue_duration_s":1.678439,"scheduling_latency_s":1.678463}2278gitlab # [ 434.283888] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc6dfbd2e551deb99dfe1293","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc6dfbd2e551deb99dfe1293: done: 0.024888 sec","job_status":"done","queue_duration_s":1.678439,"scheduling_latency_s":1.678463,"redis_calls":13,"redis_duration_s":0.0038200000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001172,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002648,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024888,"completed_at":"2026-09-09T10:38:16.568Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2279gitlab # [ 434.322321] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e87cbf8534dd309b07b18567","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e87cbf8534dd309b07b18567: start","job_status":"start","queue_duration_s":1.705373,"scheduling_latency_s":1.7054}2280gitlab # [ 434.334497] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e87cbf8534dd309b07b18567","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e87cbf8534dd309b07b18567: done: 0.020748 sec","job_status":"done","queue_duration_s":1.705373,"scheduling_latency_s":1.7054,"redis_calls":13,"redis_duration_s":0.003001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020748,"completed_at":"2026-09-09T10:38:16.591Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2281gitlab # [ 434.372555] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca596ac85c99cdef3736e281","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca596ac85c99cdef3736e281: start","job_status":"start","queue_duration_s":1.727632,"scheduling_latency_s":1.727651}2282gitlab # [ 434.385353] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca596ac85c99cdef3736e281","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca596ac85c99cdef3736e281: done: 0.017456 sec","job_status":"done","queue_duration_s":1.727632,"scheduling_latency_s":1.727651,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001729,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017456,"completed_at":"2026-09-09T10:38:16.610Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2283gitlab # [ 434.424278] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90585ea72ae01100f2567ff8","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90585ea72ae01100f2567ff8: start","job_status":"start","queue_duration_s":1.746669,"scheduling_latency_s":1.746686}2284gitlab # [ 434.436524] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90585ea72ae01100f2567ff8","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90585ea72ae01100f2567ff8: done: 0.016468 sec","job_status":"done","queue_duration_s":1.746669,"scheduling_latency_s":1.746686,"redis_calls":13,"redis_duration_s":0.0031590000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001425,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001734,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016468,"completed_at":"2026-09-09T10:38:16.628Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2285gitlab # [ 434.475909] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ac16d4ac4d2beb28513ad36","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ac16d4ac4d2beb28513ad36: start","job_status":"start","queue_duration_s":1.764505,"scheduling_latency_s":1.764521}2286gitlab # [ 434.488531] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ac16d4ac4d2beb28513ad36","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ac16d4ac4d2beb28513ad36: done: 0.015188 sec","job_status":"done","queue_duration_s":1.764505,"scheduling_latency_s":1.764521,"redis_calls":13,"redis_duration_s":0.002555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001707,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015188,"completed_at":"2026-09-09T10:38:16.645Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2287gitlab # [ 434.528651] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99569dc008584f06d0802914","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99569dc008584f06d0802914: start","job_status":"start","queue_duration_s":1.781053,"scheduling_latency_s":1.781069}2288gitlab # [ 434.540828] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99569dc008584f06d0802914","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99569dc008584f06d0802914: done: 0.015587 sec","job_status":"done","queue_duration_s":1.781053,"scheduling_latency_s":1.781069,"redis_calls":13,"redis_duration_s":0.003171,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001394,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001777,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015587,"completed_at":"2026-09-09T10:38:16.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2289gitlab # [ 434.579955] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"106b37a543f1862aa3f3f766","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-106b37a543f1862aa3f3f766: start","job_status":"start","queue_duration_s":1.798012,"scheduling_latency_s":1.798028}2290gitlab # [ 434.592843] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"106b37a543f1862aa3f3f766","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-106b37a543f1862aa3f3f766: done: 0.014842 sec","job_status":"done","queue_duration_s":1.798012,"scheduling_latency_s":1.798028,"redis_calls":13,"redis_duration_s":0.0027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001777,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014842,"completed_at":"2026-09-09T10:38:16.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2291gitlab # [ 434.630607] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"240c39ae0da4c84fe0f6d575","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-240c39ae0da4c84fe0f6d575: start","job_status":"start","queue_duration_s":1.814337,"scheduling_latency_s":1.814352}2292gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses2293gitlab # [ 434.642639] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"240c39ae0da4c84fe0f6d575","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-240c39ae0da4c84fe0f6d575: done: 0.014734 sec","job_status":"done","queue_duration_s":1.814337,"scheduling_latency_s":1.814352,"redis_calls":13,"redis_duration_s":0.002595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001711,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014734,"completed_at":"2026-09-09T10:38:16.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2294gitlab # [ 434.679209] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc2dc671c428b97d2ed19955","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc2dc671c428b97d2ed19955: start","job_status":"start","queue_duration_s":1.830355,"scheduling_latency_s":1.83037}2295gitlab # [ 434.690925] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc2dc671c428b97d2ed19955","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc2dc671c428b97d2ed19955: done: 0.014903 sec","job_status":"done","queue_duration_s":1.830355,"scheduling_latency_s":1.83037,"redis_calls":13,"redis_duration_s":0.002684,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014903,"completed_at":"2026-09-09T10:38:16.710Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2296gitlab # [ 434.729831] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05bd719d31d560133c8f2b1e","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05bd719d31d560133c8f2b1e: start","job_status":"start","queue_duration_s":1.846588,"scheduling_latency_s":1.846604}2297gitlab # [ 434.741775] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05bd719d31d560133c8f2b1e","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05bd719d31d560133c8f2b1e: done: 0.014814 sec","job_status":"done","queue_duration_s":1.846588,"scheduling_latency_s":1.846604,"redis_calls":13,"redis_duration_s":0.002608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001724,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014814,"completed_at":"2026-09-09T10:38:16.726Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2298gitlab # [ 434.780212] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8755e4785a71089dd78e4dfe","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8755e4785a71089dd78e4dfe: start","job_status":"start","queue_duration_s":1.862642,"scheduling_latency_s":1.862658}2299gitlab # [ 434.791911] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8755e4785a71089dd78e4dfe","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8755e4785a71089dd78e4dfe: done: 0.015079 sec","job_status":"done","queue_duration_s":1.862642,"scheduling_latency_s":1.862658,"redis_calls":13,"redis_duration_s":0.0027419999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001767,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015079,"completed_at":"2026-09-09T10:38:16.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2300gitlab # [ 434.829797] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b992662fcfe46376ca49d76","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b992662fcfe46376ca49d76: start","job_status":"start","queue_duration_s":1.879133,"scheduling_latency_s":1.87915}2301gitlab # [ 434.841878] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b992662fcfe46376ca49d76","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b992662fcfe46376ca49d76: done: 0.015845 sec","job_status":"done","queue_duration_s":1.879133,"scheduling_latency_s":1.87915,"redis_calls":13,"redis_duration_s":0.003228,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002322,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015845,"completed_at":"2026-09-09T10:38:16.760Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2302gitlab # [ 434.879816] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b5a7d61f0a1a96cb703a2ca","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b5a7d61f0a1a96cb703a2ca: start","job_status":"start","queue_duration_s":1.896392,"scheduling_latency_s":1.896408}2303gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses, in 0.25 seconds)2304gitlab # [ 434.892521] gitaly[903]: time="2026-09-09T10:38:18.656Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYFXY8R772JX18TGFKA6N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:48.453" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:18.654" grpc.time_ms=1.307 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab # [ 434.904683] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1452306gitlab # [ 434.907234] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b5a7d61f0a1a96cb703a2ca","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b5a7d61f0a1a96cb703a2ca: done: 0.014998 sec","job_status":"done","queue_duration_s":1.896392,"scheduling_latency_s":1.896408,"redis_calls":13,"redis_duration_s":0.002661,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001767,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014998,"completed_at":"2026-09-09T10:38:16.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2307gitlab # [ 434.946055] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00fbe9261ef9500b633c989b","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00fbe9261ef9500b633c989b: start","job_status":"start","queue_duration_s":1.912797,"scheduling_latency_s":1.912813}2308gitlab # [ 434.958174] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00fbe9261ef9500b633c989b","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00fbe9261ef9500b633c989b: done: 0.014886 sec","job_status":"done","queue_duration_s":1.912797,"scheduling_latency_s":1.912813,"redis_calls":13,"redis_duration_s":0.002587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001683,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014886,"completed_at":"2026-09-09T10:38:16.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2309gitlab # [ 434.997184] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d73d0594a94d1145b3c5537","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d73d0594a94d1145b3c5537: start","job_status":"start","queue_duration_s":1.929154,"scheduling_latency_s":1.929171}2310gitlab # [ 435.009355] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:16.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d73d0594a94d1145b3c5537","created_at":"2026-09-09T10:38:14.779Z","trace_propagation_headers":{"sentry-trace":"9582c88a045b4750a383767f20a964eb-adba354442c7423f","baggage":"sentry-trace_id=9582c88a045b4750a383767f20a964eb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"584fe028663d78c1ff6dfa4ce16515d8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-09T10:38:14.865Z","job_size_bytes":2,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d73d0594a94d1145b3c5537: done: 0.015511 sec","job_status":"done","queue_duration_s":1.929154,"scheduling_latency_s":1.929171,"redis_calls":13,"redis_duration_s":0.002785,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001857,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015511,"completed_at":"2026-09-09T10:38:16.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2311gitlab # [ 435.364933] nix-daemon[3707]: accepted connection from pid 4749, user nixbot2312gitlab # [ 435.531780] gitaly[903]: time="2026-09-09T10:38:19.350Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:49.248" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:19.349" grpc.time_ms=1.145 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab # [ 435.631352] gitaly[903]: time="2026-09-09T10:38:19.450Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:29.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:19.433" grpc.time_ms=17.093 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2314gitlab # [ 435.705790] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:19.524Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"86b404a3fde02368c111f304","created_at":"2026-09-09T10:38:19.515Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-e1004e01fce94a10","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.521Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-86b404a3fde02368c111f304: start","job_status":"start","queue_duration_s":0.002758,"scheduling_latency_s":0.002825}2315gitlab # [ 435.737898] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3142316gitlab # [ 435.742610] nixbot[3537]: {"ts": "2026-09-09T10:38:19.559Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 \"HTTP/1.1 201 Created\""}2317gitlab # [ 435.846778] gitaly[903]: time="2026-09-09T10:38:19.665Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYGXFP5DV6YC70W1DV8ST grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:49.563" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:19.664" grpc.time_ms=1.223 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2318gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses2319gitlab # [ 435.933195] gitaly[903]: time="2026-09-09T10:38:19.751Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:19.750" grpc.time_ms=0.705 pid=903 span.kind=server system=grpc2320gitlab # [ 435.956152] gitaly[903]: time="2026-09-09T10:38:19.775Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=5 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VYGXFP5DV6YC70W1DV8ST grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:29.073" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:19.754" grpc.time_ms=20.526 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2321gitlab # [ 436.007773] gitaly[903]: time="2026-09-09T10:38:19.827Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:19.826" grpc.time_ms=0.826 pid=903 span.kind=server system=grpc2322gitlab # [ 436.041882] gitaly[903]: time="2026-09-09T10:38:19.861Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYH3X17N5RRSAXASWY18R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:49.659" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:19.860" grpc.time_ms=0.743 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2323gitlab # [ 436.073077] gitaly[903]: time="2026-09-09T10:38:19.877Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:19.876" grpc.time_ms=0.438 pid=903 span.kind=server system=grpc2324gitlab # [ 436.092082] gitaly[903]: time="2026-09-09T10:38:19.882Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:38:49.701" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:19.701" operations="[repack_refs]" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2325gitlab # [ 436.108887] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2992326gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses, in 0.22 seconds)2327gitlab # [ 436.113088] nixbot[3537]: {"ts": "2026-09-09T10:38:19.862Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 \"HTTP/1.1 201 Created\""}2328gitlab # [ 436.117829] gitaly[903]: time="2026-09-09T10:38:19.886Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:38:49.701" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:19.701" pid=903 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-09 10:36:28.56709874 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2329gitlab # [ 436.136289] gitaly[903]: time="2026-09-09T10:38:19.886Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ diskcache=7b77e722-067f-4d64-a717-46bdf9bb3955 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:38:49.701" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:19.701" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2330gitlab # [ 436.149600] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses HTTP/1.1" 200 1313 "" "curl/8.21.0" 1562331gitlab # [ 436.152879] gitaly[903]: time="2026-09-09T10:38:19.886Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=134 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7364 command.oublock=0 command.real_time_ms=179 command.spawn_token_fork_ms=0 command.system_time_ms=84 command.user_time_ms=50 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:38:49.701" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:19.701" grpc.time_ms=184.832 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2332gitlab # [ 436.169167] gitaly[903]: time="2026-09-09T10:38:19.908Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:38:49.701" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:19.701" pid=903 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2333gitlab # [ 436.185653] gitaly[903]: time="2026-09-09T10:38:19.909Z" level=info msg="optimized repository" clean_stale_data_time=22.465ms clean_work_trees_time="99.86µs" commit_graph_time=520ns correlation_id=01M22VYGK9NYBZMXGXVRE862SJ gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.54µs" pid=903 prune_time=400ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.3µs" storage_name=default system=housekeeping total_time=22.6354ms2334gitlab # [ 436.192284] gitaly[903]: time="2026-09-09T10:38:19.909Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:38:49.701" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:19.701" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2335gitlab # [ 436.201995] gitaly[903]: time="2026-09-09T10:38:19.975Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-09T10:38:49.073" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:19.974" grpc.time_ms=0.949 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2336gitlab # [ 436.214570] gitaly[903]: time="2026-09-09T10:38:20.009Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:50.008" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:20.008" grpc.time_ms=0.678 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2337gitlab # [ 436.227442] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.019Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2faffb7aed046f6339dc25fa","created_at":"2026-09-09T10:38:20.017Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"86b404a3fde02368c111f304","job_size_bytes":3,"pid":3419,"job_status":"deduplicated","message":"PipelineProcessWorker JID-2faffb7aed046f6339dc25fa: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2338gitlab # [ 436.242919] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.020Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"86b404a3fde02368c111f304","created_at":"2026-09-09T10:38:19.515Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-e1004e01fce94a10","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.521Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3419,"job_status":"rescheduled","message":"PipelineProcessWorker JID-86b404a3fde02368c111f304: rescheduled"}2339gitlab # [ 436.257661] gitaly[903]: time="2026-09-09T10:38:20.022Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYH724ASNXKR463V9RKRN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:50.020" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:20.021" grpc.time_ms=0.889 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2340gitlab # [ 436.270401] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.028Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"86b404a3fde02368c111f304","created_at":"2026-09-09T10:38:19.515Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-e1004e01fce94a10","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.521Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-86b404a3fde02368c111f304: done: 0.50403 sec","job_status":"done","queue_duration_s":0.002758,"scheduling_latency_s":0.002825,"gitaly_calls":3,"gitaly_duration_s":0.200036,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.027745000000000002,"redis_read_bytes":239,"redis_write_bytes":21783,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002119,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001253,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.009062,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14468,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.00897,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000523,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00043,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003269,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.014,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.018,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.237522,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.41641858,"duration_s":0.50403,"completed_at":"2026-09-09T10:38:20.027Z","load_balancing_strategy":"primary","db_duration_s":0.051188,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2341gitlab # [ 436.321670] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.029Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"82ff627daa389d56994e17f4","created_at":"2026-09-09T10:38:19.687Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.691Z","job_size_bytes":23,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-82ff627daa389d56994e17f4: start","job_status":"start","queue_duration_s":0.337764,"scheduling_latency_s":0.337786}2342gitlab # [ 436.338258] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.072Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"82ff627daa389d56994e17f4","created_at":"2026-09-09T10:38:19.687Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.691Z","job_size_bytes":23,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-82ff627daa389d56994e17f4: done: 0.042919 sec","job_status":"done","queue_duration_s":0.337764,"scheduling_latency_s":0.337786,"redis_calls":7,"redis_duration_s":0.001994,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001454,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00054,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042919,"completed_at":"2026-09-09T10:38:20.072Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007453,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2343gitlab # [ 436.381383] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.073Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b9a85a2f4c459115ec36b598","created_at":"2026-09-09T10:38:19.901Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.905Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b9a85a2f4c459115ec36b598: start","job_status":"start","queue_duration_s":0.168565,"scheduling_latency_s":0.168584}2344gitlab # [ 436.398049] gitaly[903]: time="2026-09-09T10:38:20.098Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M22VYH724ASNXKR463V9RKRN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-09T10:38:30.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:20.080" grpc.time_ms=17.604 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2345gitlab # [ 436.411652] nixbot[3537]: {"ts": "2026-09-09T10:38:20.181Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 \"HTTP/1.1 201 Created\""}2346gitlab # [ 436.414543] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3052347gitlab # [ 436.417114] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.107Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b9a85a2f4c459115ec36b598","created_at":"2026-09-09T10:38:19.901Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.905Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b9a85a2f4c459115ec36b598: done: 0.03347 sec","job_status":"done","queue_duration_s":0.168565,"scheduling_latency_s":0.168584,"redis_calls":7,"redis_duration_s":0.004298,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00042,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03347,"completed_at":"2026-09-09T10:38:20.107Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005602,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2348gitlab # [ 436.459881] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.108Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"3577fce39899181fd47724fc","created_at":"2026-09-09T10:38:19.915Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.918Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-3577fce39899181fd47724fc: start","job_status":"start","queue_duration_s":0.190175,"scheduling_latency_s":0.190191}2349gitlab # [ 436.475947] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.148Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"3577fce39899181fd47724fc","created_at":"2026-09-09T10:38:19.915Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.918Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-3577fce39899181fd47724fc: done: 0.040022 sec","job_status":"done","queue_duration_s":0.190175,"scheduling_latency_s":0.190191,"redis_calls":7,"redis_duration_s":0.0017170000000000002,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001221,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040022,"completed_at":"2026-09-09T10:38:20.148Z","load_balancing_strategy":"primary","db_duration_s":0.00792,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2350gitlab # [ 436.518236] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.150Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"51ddfc995b44c1d2afe9afc0","created_at":"2026-09-09T10:38:19.927Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.931Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-51ddfc995b44c1d2afe9afc0: start","job_status":"start","queue_duration_s":0.218504,"scheduling_latency_s":0.218523}2351gitlab # [ 436.533914] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.185Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"51ddfc995b44c1d2afe9afc0","created_at":"2026-09-09T10:38:19.927Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.931Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-51ddfc995b44c1d2afe9afc0: done: 0.034889 sec","job_status":"done","queue_duration_s":0.218504,"scheduling_latency_s":0.218523,"redis_calls":10,"redis_duration_s":0.002529,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000764,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034889,"completed_at":"2026-09-09T10:38:20.185Z","load_balancing_strategy":"primary","db_duration_s":0.007875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2352gitlab # [ 436.578381] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.186Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"19c0fd9bfd61af2b53fb88c5","created_at":"2026-09-09T10:38:19.934Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.936Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-19c0fd9bfd61af2b53fb88c5: start","job_status":"start","queue_duration_s":0.25018,"scheduling_latency_s":0.250199}2353gitlab # [ 436.595086] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.387Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"19c0fd9bfd61af2b53fb88c5","created_at":"2026-09-09T10:38:19.934Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.936Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-19c0fd9bfd61af2b53fb88c5: done: 0.201099 sec","job_status":"done","queue_duration_s":0.25018,"scheduling_latency_s":0.250199,"redis_calls":7,"redis_duration_s":0.0012989999999999998,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.170077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.201099,"completed_at":"2026-09-09T10:38:20.387Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014045,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2354gitlab # [ 436.637914] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.391Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8e15274bc6b28eb6c3da2b92","created_at":"2026-09-09T10:38:19.937Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.940Z","job_size_bytes":19,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8e15274bc6b28eb6c3da2b92: start","job_status":"start","queue_duration_s":0.450396,"scheduling_latency_s":0.450425}2355gitlab # [ 436.653806] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.419Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8e15274bc6b28eb6c3da2b92","created_at":"2026-09-09T10:38:19.937Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.940Z","job_size_bytes":19,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8e15274bc6b28eb6c3da2b92: done: 0.028838 sec","job_status":"done","queue_duration_s":0.450396,"scheduling_latency_s":0.450425,"redis_calls":8,"redis_duration_s":0.002382,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002002,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00038,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028838,"completed_at":"2026-09-09T10:38:20.419Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2356gitlab # [ 436.695723] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.421Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"56ff637c36c7fcc045554e5a","created_at":"2026-09-09T10:38:19.941Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.944Z","job_size_bytes":66,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-56ff637c36c7fcc045554e5a: start","job_status":"start","queue_duration_s":0.476692,"scheduling_latency_s":0.476712}2357gitlab # [ 436.713004] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.455Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"56ff637c36c7fcc045554e5a","created_at":"2026-09-09T10:38:19.941Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.944Z","job_size_bytes":66,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-56ff637c36c7fcc045554e5a: done: 0.034031 sec","job_status":"done","queue_duration_s":0.476692,"scheduling_latency_s":0.476712,"redis_calls":7,"redis_duration_s":0.002009,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001583,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034031,"completed_at":"2026-09-09T10:38:20.455Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004338,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2358gitlab # [ 436.757488] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.457Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"e39d3b389f3934a3e034c6a1","created_at":"2026-09-09T10:38:19.945Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.947Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e39d3b389f3934a3e034c6a1: start","job_status":"start","queue_duration_s":0.510307,"scheduling_latency_s":0.510328}2359gitlab # [ 436.773800] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.506Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"e39d3b389f3934a3e034c6a1","created_at":"2026-09-09T10:38:19.945Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.947Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-e39d3b389f3934a3e034c6a1: done: 0.048654 sec","job_status":"done","queue_duration_s":0.510307,"scheduling_latency_s":0.510328,"redis_calls":7,"redis_duration_s":0.001441,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000599,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048654,"completed_at":"2026-09-09T10:38:20.506Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011624,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2360gitlab # [ 436.816635] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.508Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"c318642c9db186c77318df2d","created_at":"2026-09-09T10:38:19.955Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.957Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c318642c9db186c77318df2d: start","job_status":"start","queue_duration_s":0.550196,"scheduling_latency_s":0.55022}2361gitlab # [ 436.833019] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.539Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"c318642c9db186c77318df2d","created_at":"2026-09-09T10:38:19.955Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.957Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c318642c9db186c77318df2d: done: 0.031921 sec","job_status":"done","queue_duration_s":0.550196,"scheduling_latency_s":0.55022,"redis_calls":7,"redis_duration_s":0.001243,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000317,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031921,"completed_at":"2026-09-09T10:38:20.539Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2362gitlab # [ 436.875452] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.542Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"346384b02b145077b14e15ae","created_at":"2026-09-09T10:38:19.958Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.960Z","job_size_bytes":6,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-346384b02b145077b14e15ae: start","job_status":"start","queue_duration_s":0.582267,"scheduling_latency_s":0.582287}2363gitlab # [ 436.891398] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.558Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"346384b02b145077b14e15ae","created_at":"2026-09-09T10:38:19.958Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.960Z","job_size_bytes":6,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-346384b02b145077b14e15ae: done: 0.016053 sec","job_status":"done","queue_duration_s":0.582267,"scheduling_latency_s":0.582287,"redis_calls":7,"redis_duration_s":0.0012460000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000366,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016053,"completed_at":"2026-09-09T10:38:20.558Z","load_balancing_strategy":"primary","db_duration_s":0.00046,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2364gitlab # [ 436.933071] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.560Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"0572ed3e9c2ed2d0e4d1de9b","created_at":"2026-09-09T10:38:19.960Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.962Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0572ed3e9c2ed2d0e4d1de9b: start","job_status":"start","queue_duration_s":0.597697,"scheduling_latency_s":0.597714}2365gitlab # [ 436.948431] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 772366gitlab # [ 436.950470] gitlab-workhorse[820]: time="2026-09-09T10:38:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672367gitlab # [ 436.952320] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 662368gitlab # [ 436.954507] gitaly[903]: time="2026-09-09T10:38:20.682Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VYHXXNR1W21DH7H0JYT7H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:20.665" grpc.time_ms=17.064 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2369gitlab # [ 436.967718] gitaly[903]: time="2026-09-09T10:38:20.749Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VYJ0C01SPKSC3KHQVY65R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:20.740" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2370gitlab # [ 436.977921] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.605Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"0572ed3e9c2ed2d0e4d1de9b","created_at":"2026-09-09T10:38:19.960Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:19.962Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0572ed3e9c2ed2d0e4d1de9b: done: 0.044879 sec","job_status":"done","queue_duration_s":0.597697,"scheduling_latency_s":0.597714,"redis_calls":7,"redis_duration_s":0.001758,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001266,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044879,"completed_at":"2026-09-09T10:38:20.605Z","load_balancing_strategy":"primary","db_duration_s":0.007109,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2371gitlab # [ 437.019976] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.607Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"98352c7d8f78d15ac822dc40","created_at":"2026-09-09T10:38:20.021Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:20.022Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-98352c7d8f78d15ac822dc40: start","job_status":"start","queue_duration_s":0.58481,"scheduling_latency_s":0.584844}2372gitlab # [ 437.035475] gitaly[903]: time="2026-09-09T10:38:20.750Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYJ0C01SPKSC3KHQVY65R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:20.740" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2373gitlab # [ 437.048882] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 572374gitlab # [ 437.050910] gitaly[903]: time="2026-09-09T10:38:20.750Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYJ0C01SPKSC3KHQVY65R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:20.740" grpc.time_ms=9.146 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2375gitlab # [ 437.065793] gitaly[903]: time="2026-09-09T10:38:20.779Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:20.778" grpc.time_ms=0.9 pid=903 span.kind=server system=grpc2376gitlab # [ 437.075353] gitaly[903]: time="2026-09-09T10:38:20.836Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:20.836" grpc.time_ms=0.535 pid=903 span.kind=server system=grpc2377gitlab # [ 437.085334] gitaly[903]: time="2026-09-09T10:38:20.848Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VYJ3QTCFQ41HE4TX4ST4F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:20.839" grpc.time_ms=8.647 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2378gitlab # [ 437.098644] gitaly[903]: time="2026-09-09T10:38:20.872Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-09T10:38:20.871" grpc.time_ms=0.59 pid=903 span.kind=server system=grpc2379gitlab # [ 437.108168] gitaly[903]: time="2026-09-09T10:38:20.881Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ diskcache=95fb88d3-7e25-4f4f-97f3-6926bed59a04 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:38:50.728" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:20.728" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2380gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses2381gitlab # [ 437.117813] gitaly[903]: time="2026-09-09T10:38:20.881Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=124 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7004 command.oublock=0 command.real_time_ms=147 command.spawn_token_fork_ms=1 command.system_time_ms=70 command.user_time_ms=54 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-09T10:38:50.728" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-09T10:38:20.728" grpc.time_ms=152.678 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2382gitlab # [ 437.130181] gitaly[903]: time="2026-09-09T10:38:20.938Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-09T10:38:50.036" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:20.937" grpc.time_ms=0.759 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2383gitlab # [ 437.141916] gitaly[903]: time="2026-09-09T10:38:20.940Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M22VYJ5MVGAB324H4SHFGR9V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:20.930" pid=903 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2384gitlab # [ 437.151571] gitlab-workhorse[820]: time="2026-09-09T10:38:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672385gitlab # [ 437.153373] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 882386gitlab # [ 437.155100] gitaly[903]: time="2026-09-09T10:38:20.940Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYJ5MVGAB324H4SHFGR9V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:20.930" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2387gitlab # [ 437.168731] gitaly[903]: time="2026-09-09T10:38:20.940Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYJ5MVGAB324H4SHFGR9V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-09T10:38:20.930" grpc.time_ms=9.709 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2388gitlab # [ 437.182953] gitaly[903]: time="2026-09-09T10:38:20.976Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYGK9NYBZMXGXVRE862SJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:50.074" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:20.975" grpc.time_ms=0.764 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2389gitlab # [ 437.196281] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:20.992Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"98352c7d8f78d15ac822dc40","created_at":"2026-09-09T10:38:20.021Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:20.022Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3419,"job_status":"rescheduled","message":"PipelineProcessWorker JID-98352c7d8f78d15ac822dc40: rescheduled"}2390gitlab # [ 437.210836] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:21.008Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"98352c7d8f78d15ac822dc40","created_at":"2026-09-09T10:38:20.021Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-40c569037cf84635","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:20.022Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-98352c7d8f78d15ac822dc40: done: 0.401009 sec","job_status":"done","queue_duration_s":0.58481,"scheduling_latency_s":0.584844,"gitaly_calls":3,"gitaly_duration_s":0.163446,"redis_calls":68,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.018894,"redis_read_bytes":149,"redis_write_bytes":18175,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.001009,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001575,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":22,"redis_queues_duration_s":0.005479,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12317,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.0074,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000463,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00033,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001629,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.016,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.016,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.182108,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.33177154,"duration_s":0.401009,"completed_at":"2026-09-09T10:38:21.008Z","load_balancing_strategy":"primary","db_duration_s":0.044746,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2391gitlab # [ 437.262241] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:21.011Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fdd2ab927e3ee63e473c612d","created_at":"2026-09-09T10:38:20.715Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-e48cbab4ff514cdf","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:20.719Z","job_size_bytes":23,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fdd2ab927e3ee63e473c612d: start","job_status":"start","queue_duration_s":0.291896,"scheduling_latency_s":0.291942}2392gitlab # [ 437.278786] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:21.067Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fdd2ab927e3ee63e473c612d","created_at":"2026-09-09T10:38:20.715Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-e48cbab4ff514cdf","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:20.719Z","job_size_bytes":23,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fdd2ab927e3ee63e473c612d: done: 0.056818 sec","job_status":"done","queue_duration_s":0.291896,"scheduling_latency_s":0.291942,"redis_calls":7,"redis_duration_s":0.004099,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003785,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000314,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056818,"completed_at":"2026-09-09T10:38:21.067Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01037,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2393gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses, in 0.21 seconds)2394(finished: subtest: eval and build post commit statuses, in 12.44 seconds)2395(finished: run the VM test script, in 507.99 seconds)2396gitlab # [ 437.321867] gitaly[903]: time="2026-09-09T10:38:21.088Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M22VYJAWAMMXMCW2M8XCME46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-09T10:38:51.086" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-09T10:38:21.087" grpc.time_ms=0.854 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2397gitlab # [ 437.334196] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/09:10:38:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 1012398gitlab # [ 437.336861] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:21.069Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0668bb6ad743b9a4e3c667bd","created_at":"2026-09-09T10:38:20.889Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-e48cbab4ff514cdf","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:20.891Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0668bb6ad743b9a4e3c667bd: start","job_status":"start","queue_duration_s":0.177907,"scheduling_latency_s":0.177929}2399test script finished in 508.05s2400cleanup2401kill QemuMachine (pid 46)2402gitlab # [ 437.356473] sidekiq-cluster[3419]: {"severity":"INFO","time":"2026-09-09T10:38:21.113Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0668bb6ad743b9a4e3c667bd","created_at":"2026-09-09T10:38:20.889Z","trace_propagation_headers":{"sentry-trace":"f407143dae6d44a3baf7c180b98781da-e48cbab4ff514cdf","baggage":"sentry-trace_id=f407143dae6d44a3baf7c180b98781da,sentry-release=Unknown"},"correlation_id":"01M22VYGK9NYBZMXGXVRE862SJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-09T10:38:20.891Z","job_size_bytes":3,"pid":3419,"sidekiq_tid":"m8mf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0668bb6ad743b9a4e3c667bd: done: 0.043313 sec","job_status":"done","queue_duration_s":0.177907,"scheduling_latency_s":0.177929,"redis_calls":7,"redis_duration_s":0.005476,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00049,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"dqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2403gitlab # b2404(finished: cleanup, in 1.59 seconds)2405additionally exposed symbols:2406 gitlab,2407 vlan1,2408 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2409[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-09T10:36:39.903Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2410[]2411[]2412[]2413[]2414[]2415[]2416[]2417[]2418[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-09T10:38:08.613324Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}]2419[]2420[{'id': 5, 'sha': 'f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-09T10:38:09.018Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2421[{'id': 5, 'sha': 'f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-09T10:38:09.018Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2422[{'id': 5, 'sha': 'f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-09T10:38:09.018Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2423[{'id': 5, 'sha': 'f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-09T10:38:09.018Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2424[{'id': 5, 'sha': 'f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-09T10:38:09.018Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2425[{'id': 5, 'sha': 'f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-09T10:38:09.018Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2426[{'id': 5, 'sha': 'f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-09T10:38:09.018Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2427[{'id': 5, 'sha': 'f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-09T10:38:09.018Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2428[{'id': 5, 'sha': 'f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-09T10:38:09.018Z', 'started_at': None, 'finished_at': '2026-09-09T10:38:19.496Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-09-09T10:38:19.822Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2429[{'id': 5, 'sha': 'f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-09T10:38:09.018Z', 'started_at': None, 'finished_at': '2026-09-09T10:38:19.496Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'f5b5ea6a59b68f2764eb9cdfd0400b49dec68bc5', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-09-09T10:38:19.822Z', 'started_at': None, 'finished_at': '2026-09-09T10:38:20.140Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]